Big Data Engineer
ZoomFull Time
Junior (1 to 2 years), Mid-level (3 to 4 years)
Candidates should possess 5+ years of work experience in a relevant field such as Data Engineer, DWH Engineer, or Software Engineer. Experience with data-lake and data-warehousing technologies, data modeling best practices (Presto, Athena, Glue, etc.), and proficiency in Python or Scala are required. Familiarity with Airflow for building data pipelines/ETL, excellent SQL and data manipulation skills using frameworks like Spark/PySpark, and expertise in Apache Spark or similar Big Data technologies are also necessary. Experience with business requirements gathering for data sourcing is needed, with Kafka and other streaming technologies like Apache Flink considered a bonus.
The Data Engineer will be responsible for building and maintaining high-performance data pipelines, ensuring the reliability and scalability of data infrastructure, and enabling teams to access clean, consistent, and timely data. This includes building scalable and reliable data pipelines to collect, transform, load, and curate data from internal systems, augmenting the data platform with data pipelines from external systems, and ensuring high data quality for built pipelines. The role also involves driving data systems towards near real-time performance, supporting the design and deployment of distributed data stores, building data connections to internal IT systems, and developing self-service tools for data consumers. Additionally, the Data Engineer will evaluate new technologies and build prototypes for continuous improvements in data engineering.
Cryptocurrency exchange for buying and trading
Kraken is a cryptocurrency exchange platform that allows users to buy, sell, and trade various digital assets. It offers features that cater to both beginners and experienced traders, making it easy to navigate the cryptocurrency market. Users can execute trades with high liquidity, which means their transactions are completed quickly. The platform charges low transaction fees, sometimes as low as 0%, helping users keep more of their profits. Kraken also provides advanced charting tools to help investors track their investments effectively. Security is a major focus, with multiple protective measures in place to keep user assets safe. The platform supports 70 different asset pairs and is continuously expanding its offerings. Additionally, Kraken offers 24/7 global support to assist users with any questions or issues.