Data Engineer -- NYC at Qloo

New York, New York, United States

Apply Now

Not SpecifiedCompensation

Mid-level (3 to 4 years), Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

Biotechnology, Data & AnalyticsIndustries

Requirements

Candidates should have 2-5 years of experience in data engineering and a Bachelor's degree in computer science, software engineering, or a related field. Experience with SQL and automating data processing through Python libraries like Airflow is required, along with experience with AWS or other cloud platforms. Strong problem-solving and analytical skills with keen attention to detail are necessary, and the ability to manage multiple projects simultaneously and meet tight deadlines is essential. Experience with Spark and cloud platforms is preferred.

Responsibilities

The Data Engineer will design, develop, and maintain automated data pipelines on Airflow using Python, PySpark, and SQL. They will ensure data quality by proactively catching and rectifying quality issues, and collaborate with data scientists and other engineers to define data requirements and structures. Responsibilities include writing unit tests, conducting system testing, and optimizing data pipelines for speed, scalability, and accuracy. The role also involves staying up-to-date with emerging trends and technologies in data engineering, data processing, distributed computing, and data quality assurance.

Skills

Airflow

Python

PySpark

ETL

Data Pipelines

SQL

Qloo

AI-driven consumer preference prediction platform

About Qloo

Qloo offers a "Cultural AI" that predicts global consumer preferences and provides contextualized personalization and insights based on a deep understanding of consumer behavior and over 575 million cultural entities. Their privacy-first API and cutting-edge machine learning processes empower companies to uncover connections behind people’s taste in various cultural domains such as music, film, fashion, and dining.

New York City, New YorkHeadquarters

2012Year Founded

$72MTotal Funding

GROWTH_EQUITY_VCCompany Stage

Data & Analytics, Consumer Software, AI & Machine LearningIndustries

51-200Employees