Big Data Engineer
ZoomFull Time
Junior (1 to 2 years), Mid-level (3 to 4 years)
The candidate should possess over 5 years of work experience in Data Engineering, Data Warehousing, or Software Engineering. Experience with data lake and data warehousing technologies, including data modeling best practices like Presto, Athena, and Glue, is required. Proficiency in Python or Scala, experience building data pipelines with Airflow, and excellent SQL and data manipulation skills using frameworks like Spark/PySpark are essential. Expertise in Apache Spark or similar Big Data technologies and experience with business requirements gathering for data sourcing are also necessary. Familiarity with Kafka and streaming technologies like Apache Flink is considered a bonus.
The Data Engineer will build and maintain scalable, reliable data pipelines for collecting, transforming, loading, and curating data from internal and external systems. They will ensure high data quality and auditability for these pipelines, driving them towards near real-time performance. Responsibilities include supporting the design and deployment of distributed data stores, building data connections to internal IT systems, and developing self-service tools for data consumers. The role also involves evaluating new technologies and building prototypes for continuous improvement in data engineering practices.
Cryptocurrency exchange for buying and trading
Kraken is a cryptocurrency exchange platform that allows users to buy, sell, and trade various digital assets. It offers features that cater to both beginners and experienced traders, making it easy to navigate the cryptocurrency market. Users can execute trades with high liquidity, which means their transactions are completed quickly. The platform charges low transaction fees, sometimes as low as 0%, helping users keep more of their profits. Kraken also provides advanced charting tools to help investors track their investments effectively. Security is a major focus, with multiple protective measures in place to keep user assets safe. The platform supports 70 different asset pairs and is continuously expanding its offerings. Additionally, Kraken offers 24/7 global support to assist users with any questions or issues.