Senior Data Engineer (AWS, EMR, Airflow, Python, Spark, Gitlab/ GitHub) at Nielsen

Pune, Maharashtra, India

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

Media MeasurementIndustries

Requirements

+6 years of relevant experience in AWS Data Engineering
Solid hands-on experience with Python and experience with Java or Scala
Knowledge in how to develop data-intensive applications using Spark
Knowledge in writing SQL queries to wrangle data from relational databases
Knowledge in how to orchestrate data pipelines with Airflow or any other similar data scheduling and orchestration tool
Experience with AWS and ideally Terraform, Data Lake & Lake Formation, Open Table formats like Apache Iceberg
Experience in EMR
Experience with CI/CD such as Gitlab & Github
Following best practices in software engineering, like pair programming, testing, clean code and agile software development frameworks

Responsibilities

Design, develop, test and deploy big data applications and pipelines
Ensure that your and the team's work follow best practices for ensuring validity, efficiency and maintainability
Collaborate in a distributed, cross-functional agile team of Data Scientists and Cloud Engineers to reach shared goals
Take ownership of technical implementations and architecture together with your team and in alignment with communities of practices
Communicate with data producers & consumers to align on data exchange formats and interfaces
Provide suggestions to business in the Media Measurement context on how existing and new data sources can be utilized to enhance our existing product portfolio
Recommend different ways to constantly improve data reliability and quality

Skills

AWS

EMR

Airflow

Python

Spark

SQL

Java

Scala

Terraform

Data Lake

Lake Formation

Apache Iceberg

Gitlab

Github

CI/CD

Nielsen

Global measurement and data analytics provider

About Nielsen

Nielsen provides measurement and data analytics services to help businesses understand consumers and markets globally. The company operates through two main divisions: Nielsen Global Media, which offers reliable metrics for the media and advertising industries, and Nielsen Global Connect, which supplies consumer packaged goods manufacturers and retailers with actionable insights about the marketplace. Nielsen combines its proprietary data with other sources to give clients a comprehensive view of current trends and future opportunities. With a presence in over 100 countries, Nielsen aims to support companies in making informed decisions to drive innovation and growth.

Town of Clarkstown, New YorkHeadquarters

1963Year Founded

$45.1MTotal Funding

ACQUISITIONCompany Stage

Data & Analytics, ConsultingIndustries

10,001+Employees

Benefits

Health Insurance

401(k) Retirement Plan

401(k) Company Match

Unlimited Paid Time Off

Risks

Competition from digital-native analytics firms threatens Nielsen's market share.

Privacy regulations may impact Nielsen's data collection capabilities.

Private equity acquisition could lead to strategic shifts misaligned with client needs.

Differentiation

Nielsen offers comprehensive cross-platform measurement solutions, including mobile media markets.

The Diverse Media Equity program elevates diverse-owned media companies' visibility.

Nielsen Impact Score evaluates marketing value of university athletic programs.

Upsides

Acquisition of Telephia enhances Nielsen's mobile media measurement capabilities.

Partnerships with P&G and NMSDC support diverse media representation.

Collaboration with TikTok improves digital audience measurement services.

Land your dream remote job 3x faster with AI

Try Jobo Free