Senior Data Engineer (Apache Airflow, DBT/Snowpark/PySpark, Python and SQL, Stored procedures) at Nielsen

Pune, Maharashtra, India

Nielsen Logo
Not SpecifiedCompensation
Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
Financial Services, Data AnalyticsIndustries

Requirements

  • 5+ years of hands-on programming experience with Python and SQL including familiarity with stored procedures, Snowflake, dbt, and Airflow
  • 5+ years of experience with PySpark to design, optimize and scale distributed data processing pipelines
  • Experience working on data modeling
  • Familiarity with a cloud provider (AWS, GCP, Azure) and their data infrastructure services (e.g., S3, EC2, etc.)
  • Bachelor’s or Master’s degree in Computer Science, Engineering, or related field
  • 5+ years’ experience as a Data Engineer, Database Developer, or similar role
  • Experience working with Airflow, Pyspark, and Snowflake
  • Strong knowledge and experience with SQL Server, Stored Procedures, and OLAP BI tools
  • Expertise in MDX or similar query languages for complex data analysis
  • Strong organizational skills with an ability to manage multiple projects and priorities
  • Strong entrepreneurial spirit and a thirst to solve difficult challenges through innovation and creativity with a strong focus on results
  • Passion for data and the insights it can deliver
  • Intellectually curious with a broad range of interests and hobbies
  • Takes ownership of deliverables
  • Excellent analytical communication and interpersonal skills
  • Excellent communication skills with both technical and non-technical audiences
  • Ability to work with distributed teams situated globally in different geographies
  • Ability to work in a team with a start-up mentality
  • Ability to work well under pressure, prioritize work, and be well organized
  • Relishes tackling new challenges, paying attention to details, and growing professionally

Responsibilities

  • Refactor existing SQL stored procedures into modular, maintainable data pipelines using Apache Airflow
  • Translate complex business logic into modern transformation frameworks (DBT/Snowpark/PySpark)
  • Utilize programming languages like Python or JavaScript to build robust data pipelines and implement ETL processes
  • Collaborate with data engineers/analysts, business stakeholders, and IT team members on project goals
  • Maintain and improve data infrastructure to develop market research products and deliver data to customers
  • Work with big data and cloud services such as AWS, Snowflake, Databricks, DBT, Airflow, and Looker

Skills

Apache Airflow
DBT
Snowpark
PySpark
Python
SQL
Stored Procedures
AWS
Snowflake
Databricks
Looker

Nielsen

Global measurement and data analytics provider

About Nielsen

Nielsen provides measurement and data analytics services to help businesses understand consumers and markets globally. The company operates through two main divisions: Nielsen Global Media, which offers reliable metrics for the media and advertising industries, and Nielsen Global Connect, which supplies consumer packaged goods manufacturers and retailers with actionable insights about the marketplace. Nielsen combines its proprietary data with other sources to give clients a comprehensive view of current trends and future opportunities. With a presence in over 100 countries, Nielsen aims to support companies in making informed decisions to drive innovation and growth.

Town of Clarkstown, New YorkHeadquarters
1963Year Founded
$45.1MTotal Funding
ACQUISITIONCompany Stage
Data & Analytics, ConsultingIndustries
10,001+Employees

Benefits

Health Insurance
401(k) Retirement Plan
401(k) Company Match
Unlimited Paid Time Off

Risks

Competition from digital-native analytics firms threatens Nielsen's market share.
Privacy regulations may impact Nielsen's data collection capabilities.
Private equity acquisition could lead to strategic shifts misaligned with client needs.

Differentiation

Nielsen offers comprehensive cross-platform measurement solutions, including mobile media markets.
The Diverse Media Equity program elevates diverse-owned media companies' visibility.
Nielsen Impact Score evaluates marketing value of university athletic programs.

Upsides

Acquisition of Telephia enhances Nielsen's mobile media measurement capabilities.
Partnerships with P&G and NMSDC support diverse media representation.
Collaboration with TikTok improves digital audience measurement services.

Land your dream remote job 3x faster with AI