MTS 4 - Data Engineer at Nielsen

Mumbai, Maharashtra, India

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

Media, TechnologyIndustries

Requirements

8+ Years of experience
At least 4 years in the web domain
Strong programming skills using at least one of the languages like Spark, Scala, Python
Working knowledge of AWS Cloud Servers and related services
Good knowledge of RDBMS (MySQL), database designing, and query optimization techniques
Experience with NoSQL (MongoDB / DynamoDB / DocumentDB) databases (added advantage)
Experience with Data ETL (Extract Transform and Load) using Legacy and Cloud based services
Knowledge of version controlling systems like GitLab, clear understanding of Gitflow workflow, repository management tools like BitBucket, and understanding of the overall CI/CD process
Knowledge with real time streaming data processing using technologies like Kafka & Spark (plus)
Knowledge of big data processing and query technologies like Hadoop, Hive and Pig (plus)
Knowledge of User Interface design and Data Visualization and Reports (plus)
Knowledge of container technologies like Docker and Kubernetes
Knowledge of infrastructure as code using Terraform, Cloudformation and Ansible
Desire to leverage DevOps techniques including fully automated testing and deployment, Agile methodology and continuous integration/continuous delivery
Experience with instrumenting logging and monitoring into applications
Experience with setting up test environments, designing test plans, developing test cases/scenarios/usage cases, and executing these cases
Experience with Linux OS and Shell scripting
Experience with all aspects of product/system development life cycle
Desire to invent the next generation of measurement techniques; Passionate about technology and the desire to grow professionally; Creative thinkers who can propose solutions to tough problems and collaborate well with other Engineers

Responsibilities

Development of frontend and database systems
Collaboration with various Nielsen teams (collection, processing, testing, operations, partners)
Leveraging DevOps techniques for automated testing and deployment
Utilizing version control systems (Git)
Working with streaming data processing technologies (Kafka & Spark)
Implementing data ETL processes
Designing and optimizing databases
Contributing to the development of new measurement techniques

Skills

Key technologies and capabilities for this role

SparkScalaPythonAWSMySQLMongoDBDynamoDBDocumentDBETLGitLabBitBucketKafkaHadoopHiveDockerKubernetesTerraformCloudFormationAnsible

Questions & Answers

Common questions about this position

What programming skills are required for this Data Engineer role?

Strong programming skills using at least one of the languages like Spark, Scala, Python are required, along with experience in RDBMS like MySQL, NoSQL databases, and ETL processes.

What is the required experience level for this position?

Candidates need 8+ years of experience overall, with at least 4 years in the web domain.

Is this position remote or does it require office work?

This information is not specified in the job description.

What is the salary or compensation for this role?

This information is not specified in the job description.

What kind of candidate stands out for this Data Engineer position?

Strong candidates have 8+ years of experience, proficiency in Spark/Scala/Python, AWS knowledge, DevOps practices, and desirable traits like passion for technology, creativity in solving problems, and collaborative skills.

Nielsen

Global measurement and data analytics provider

About Nielsen

Nielsen provides measurement and data analytics services to help businesses understand consumers and markets globally. The company operates through two main divisions: Nielsen Global Media, which offers reliable metrics for the media and advertising industries, and Nielsen Global Connect, which supplies consumer packaged goods manufacturers and retailers with actionable insights about the marketplace. Nielsen combines its proprietary data with other sources to give clients a comprehensive view of current trends and future opportunities. With a presence in over 100 countries, Nielsen aims to support companies in making informed decisions to drive innovation and growth.

Town of Clarkstown, New YorkHeadquarters

1963Year Founded

$45.1MTotal Funding

ACQUISITIONCompany Stage

Data & Analytics, ConsultingIndustries

10,001+Employees