Senior Big Data Engineer at dunnhumby

Gurugram, Haryana, India

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

Retail, Consumer GoodsIndustries

Requirements

Bachelor's or master's degree in computer science, Information Systems, Data Science, or related field
5+ years of experience in data architecture, data engineering, or a related field
Proficient in data pipeline tools such as Apache Spark, Kafka, Airflow, or similar
Experience with data governance frameworks and tools (e.g., Collibra, Alation, OpenMetadata)
Strong knowledge of cloud platforms (Azure or Google Cloud), especially with cloud-native data services
Strong understanding of API design and data security best practices
Familiarity with data mesh, data fabric, or other emerging architectural patterns
Experience working in Agile or DevOps

Responsibilities

Design end-to-end data solutions, including data lakes, data warehouses, ETL/ELT pipelines, APIs, and analytics platforms
Architect scalable and low-latency data pipelines using tools like Apache Kafka, Flink, or Spark Streaming to handle high-velocity data streams
Design/Orchestrate end-to-end automation using orchestration frameworks such as Apache Airflow to manage complex workflows and dependencies
Design intelligent systems that can detect anomalies, trigger alerts, and automatically reroute or restart processes to maintain data integrity and availability
Develop scalable data architecture strategies that support advanced analytics, machine learning, and real-time data processing
Define and implement data governance, metadata management, and data quality standards
Lead architectural reviews and technical design sessions to guide solution development
Partner with business and IT teams to translate business needs into data architecture requirements
Explore appropriate tools, platforms, and technologies aligned with organizational standards
Ensure security, compliance, and regulatory requirements are addressed in all data solutions
Evaluate and recommend improvements to existing data architecture and processes
Provide mentorship and guidance to data engineers and technical teams

Skills

Data Lakes

Data Warehouses

ETL

ELT

APIs

Analytics Platforms

Big Data Engineering

dunnhumby

Customer data analytics for retail optimization

About dunnhumby

dunnhumby specializes in Customer Data Science, focusing on enhancing customer experiences for retailers and brands through data analysis. The company uses advanced analytics to interpret customer behavior, preferences, and trends, which allows clients to implement targeted marketing campaigns. Instead of storing personal data, dunnhumby analyzes data using unique identifiers from browsers and devices to maintain privacy. Its services include media solutions, customer insights, and personalized marketing strategies, which help clients improve customer engagement and sales. Additionally, dunnhumby Ventures invests in early-stage retail technology startups, ensuring the company remains at the forefront of retail innovation. The main goal of dunnhumby is to empower businesses to create better customer experiences through data-driven insights.

London, United KingdomHeadquarters

1989Year Founded

BUYOUT_LBOCompany Stage

Data & Analytics, Consulting, Venture Capital, Consumer GoodsIndustries

1,001-5,000Employees