Data Engineer at Nielsen

Chennai, Tamil Nadu, India

Apply Now

Not SpecifiedCompensation

Mid-level (3 to 4 years)Experience Level

Full TimeJob Type

UnknownVisa

TechnologyIndustries

Requirements

B.E./B.Tech. with a major in Computer Science, BIS, CIS, Electrical Engineering, Operations Research or other technical field
Course work or experience in Numerical Analysis, Mathematics or Statistics (plus)
Proven experience working as a data engineer (minimum 3-6 years)
Highly proficient in using the Spark framework (Python and/or Scala)
Extensive knowledge of Data Warehousing concepts, strategies, methodologies
Programming experience in Python, SQL, Scala
Direct experience building data pipelines using Apache Spark (preferably in Databricks), Airflow
Hands-on experience designing and delivering solutions using Azure (Azure Storage, Azure SQL Data Warehouse, Azure Data Lake)
Experience with big data technologies (Hadoop)
Databricks & Azure Big Data Architecture Certification (plus)
Team oriented with strong collaboration, prioritization, and adaptability skills
Ability to write highly efficient code in terms of performance / memory utilization
Basic knowledge of SQL; capable of handling common functions
Experience modeling or manipulating large amounts of data (plus)
Experience with Demographic, Retail business (plus)

Responsibilities

Assemble large, complex sets of data that meet non-functional and functional business requirements
Identify, design and implement internal process improvements: re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes
Build required infrastructure for optimal extraction, transformation and loading of data from various data sources using Azure, Databricks and SQL technologies
Transform conceptual algorithms from R&D into efficient, production ready code (requires strong mathematical background to document and maintain the code)
Integrate finished models into larger data processes using UNIX scripting languages such as ksh, Python, Spark, Scala, etc
Produce and maintain documentation for released data sets, new programs, shared utilities, or static data within department standards
Ensure quality deliverables to clients by following existing quality processes, manually calculating comparison data, developing statistical pass/fail testing, and visually inspecting data for reasonableness (on-time with zero defects)

Skills

Key technologies and capabilities for this role

AzureDatabricksSQLSparkPythonScalaData WarehousingETLData PipelinesUNIXksh

Questions & Answers

Common questions about this position

Is this position remote or on-site?

The position is on-site.

What are the key technical skills required for this Data Engineer role?

Key skills include proficiency in Spark (Python and/or Scala), Python, SQL, Scala, building data pipelines with Apache Spark in Databricks and Airflow, and Azure technologies like Azure Storage, Azure SQL Data Warehouse, and Azure Data Lake.

What is the required experience level for this position?

Minimum 3-6 years of experience as a Data Engineer is required.

What benefits does Nielsen offer?

Benefits include a flexible working environment, volunteer time off, LinkedIn Learning, and Employee-Assistance-Program (EAP).

What education is required for this role?

A B.E./B.Tech. with a major in Computer Science, BIS, CIS, Electrical Engineering, Operations Research or some other technical field is required; coursework or experience in Numerical Analysis, Mathematics or Statistics is a plus.

Nielsen

Global measurement and data analytics provider

About Nielsen

Nielsen provides measurement and data analytics services to help businesses understand consumers and markets globally. The company operates through two main divisions: Nielsen Global Media, which offers reliable metrics for the media and advertising industries, and Nielsen Global Connect, which supplies consumer packaged goods manufacturers and retailers with actionable insights about the marketplace. Nielsen combines its proprietary data with other sources to give clients a comprehensive view of current trends and future opportunities. With a presence in over 100 countries, Nielsen aims to support companies in making informed decisions to drive innovation and growth.

Town of Clarkstown, New YorkHeadquarters

1963Year Founded

$45.1MTotal Funding

ACQUISITIONCompany Stage

Data & Analytics, ConsultingIndustries

10,001+Employees

Benefits

Health Insurance

401(k) Retirement Plan

401(k) Company Match

Unlimited Paid Time Off

Risks

Competition from digital-native analytics firms threatens Nielsen's market share.

Privacy regulations may impact Nielsen's data collection capabilities.

Private equity acquisition could lead to strategic shifts misaligned with client needs.

Differentiation

Nielsen offers comprehensive cross-platform measurement solutions, including mobile media markets.

The Diverse Media Equity program elevates diverse-owned media companies' visibility.

Nielsen Impact Score evaluates marketing value of university athletic programs.

Upsides

Acquisition of Telephia enhances Nielsen's mobile media measurement capabilities.

Partnerships with P&G and NMSDC support diverse media representation.

Collaboration with TikTok improves digital audience measurement services.

Land your dream remote job 3x faster with AI

Try Jobo Free