Senior Data Engineer at dunnhumby

Gurugram, Haryana, India

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

Retail, Retail Media, Customer Data ScienceIndustries

Requirements

7–9 years of experience as a Data Engineer
Prior experience working with scalable architecture and distributed data processing systems
Strong programming skills in SQL and PySpark
Proficiency in big data solutions such as Apache Spark and Hive
Experience with big data workflow orchestrators like Argo Workflows
Hands-on experience with cloud-based data stores like Redshift or BigQuery (preferred)
Familiarity with cloud platforms, preferably GCP or Azure
Strong programming skills in Python, with experience in frameworks like FastAPI or similar API frameworks
Proficiency in unit testing and ensuring code quality
Hands-on experience with version control tools like Git
Ability to analyze complex data pipelines, identify performance bottlenecks, and suggest optimization strategies
Excellent problem-solving skills and the ability to work effectively in a team environment
Strong communication skills to collaborate across teams and share technical insights
Nice to have: Experience with microservices architecture, containerization using Docker, and orchestration tools like Kubernetes

Responsibilities

Contribute to the design, development, and optimization of real-time and batch data processing pipelines for retail media measurement solution
Work with tools such as Python, Apache Spark, and streaming frameworks to process and analyze data
Support near-real-time decision-making for critical business applications in the retail media space
Collaborate with cross-functional teams, including Data Scientists, Analysts, and Senior Engineers, to build robust and efficient data solutions
Implement scalable data pipelines under the guidance of senior team members
Gain hands-on experience with streaming and batch processing systems
Ensure the reliability and performance of data infrastructure
Work collaboratively with infrastructure teams to ensure a robust and scalable platform for data science workflows
Design, build, and scale solutions that enable the accurate measurement of retail media campaigns across various channels
Provide actionable insights to empower stakeholders to optimize media investments, improve ROI, and enhance the overall customer experience

Skills

Key technologies and capabilities for this role

PythonApache SparkData Processing PipelinesStreaming FrameworksReal-time Data ProcessingBatch Processing

Questions & Answers

Common questions about this position

What experience level is required for this Senior Data Engineer role?

The role requires 7–9 years of experience as a Data Engineer, along with prior experience working with scalable architecture and distributed data processing systems.

What technical skills are needed for this position?

Candidates need strong programming skills in SQL and PySpark, proficiency in big data solutions such as Apache Spark and Hive, experience with Argo Workflows, and hands-on experience with cloud-based data stores like Redshift or BigQuery.

What is the salary or compensation for this role?

This information is not specified in the job description.

Is this a remote position, or where is it located?

This information is not specified in the job description.

What teams will I work with in this role?

You will collaborate with cross-functional teams, including Data Scientists, Analysts, and Senior Engineers.

dunnhumby

Customer data analytics for retail optimization

About dunnhumby

dunnhumby specializes in Customer Data Science, focusing on enhancing customer experiences for retailers and brands through data analysis. The company uses advanced analytics to interpret customer behavior, preferences, and trends, which allows clients to implement targeted marketing campaigns. Instead of storing personal data, dunnhumby analyzes data using unique identifiers from browsers and devices to maintain privacy. Its services include media solutions, customer insights, and personalized marketing strategies, which help clients improve customer engagement and sales. Additionally, dunnhumby Ventures invests in early-stage retail technology startups, ensuring the company remains at the forefront of retail innovation. The main goal of dunnhumby is to empower businesses to create better customer experiences through data-driven insights.

London, United KingdomHeadquarters

1989Year Founded

BUYOUT_LBOCompany Stage

Data & Analytics, Consulting, Venture Capital, Consumer GoodsIndustries

1,001-5,000Employees

Benefits

Flexible Work Hours

Unlimited Paid Time Off

Remote Work Options

Risks

Departure of key media team member may disrupt dunnhumby's media strategy.

Challenges in integrating startups with enterprises could misalign innovation goals.

Data privacy concerns may arise from partnerships, affecting client trust.

Differentiation

dunnhumby leverages AI to optimize product selection and inventory management.

The company offers a unique Competitive Threat Evaluator for strategic market insights.

dunnhumby partners with startups through its Retail Innovation Network to drive retail tech.

Upsides

Real-time data analytics partnerships enhance dunnhumby's market adaptability.

AI-powered tools position dunnhumby as a leader in competitive retail analysis.

The Retail Innovation Network fosters collaboration, boosting innovation in retail technology.

Land your dream remote job 3x faster with AI

Try Jobo Free