Senior Data Engineer at WPP

Gurugram, Haryana, India

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

Marketing, AdvertisingIndustries

Requirements

Bachelor's degree in Computer Science, Engineering, Mathematics, or a related technical field (preferred)
8+ years of relevant experience in data engineering, with significant focus on building data pipelines on distributed systems
Deep expertise in Databricks Lakehouse Platform
Deep, hands-on experience with Apache Spark architecture, writing and optimizing complex PySpark and Spark SQL jobs
Proven ability to use the Spark UI to diagnose and resolve performance issues

Responsibilities

Design, build, and deploy robust ETL/ELT pipelines within the Databricks Lakehouse Platform using PySpark and Spark SQL
Implement and manage the Medallion Architecture (Bronze, Silver, Gold layers) using Delta Lake to ensure data quality and progressive data refinement
Leverage Databricks Auto Loader for efficient, scalable, and incremental ingestion of data from sources like GA4 into the Bronze layer
Develop, schedule, and monitor complex, multi-task data workflows using Databricks Workflows
Optimize Spark jobs and Delta Lake tables (using techniques like OPTIMIZE, Z-ORDER, and partitioning) for high performance and cost efficiency
Implement data governance, security, and discovery using Unity Catalog, including managing access controls and data lineage
Write complex, customized SQL queries to manipulate data and support ad-hoc analytical requests from business teams
Develop strategies for data ingestion from multiple sources, using various techniques including streaming, API consumption, and replication
Document data engineering processes, data models, and technical specifications for the Databricks platform
Conform to agile development practices, including version control (Git), continuous integration/delivery (CI/CD), and test-driven development
Provide production support for data pipelines, actively monitoring and resolving issues to ensure the continuous flow of critical data
Collaborate with analytics and business teams to understand data requirements and deliver well-modelled, performant datasets in the Gold layer

Skills

Databricks

PySpark

Apache Spark

SQL

Google Analytics 4

ETL

ELT

WPP

Global marketing and communications services provider

About WPP

WPP operates in the marketing and communications industry, providing a variety of services such as branding, digital marketing, media planning, market research, public relations, and business transformation. Their approach integrates creativity with data and technology, helping clients build strong brands and engage effectively with their audiences. WPP stands out from competitors by focusing on innovation and sustainability, participating in global initiatives like the United Nations Climate Change Conference, and producing thought leadership content like the Atticus Journal. The company's goal is to be a strategic partner for businesses, aiding them in navigating the complexities of modern marketing and achieving their objectives.

London, United KingdomHeadquarters

2015Year Founded

IPOCompany Stage

Consulting, Social ImpactIndustries

10,001+Employees

Risks

Increased competition from Publicis, gaining market share and outperforming WPP in certain areas.

Potential over-reliance on strategic partnerships may limit WPP's flexibility and independence.

Challenges in effectively integrating AI into operations indicate potential gaps in current capabilities.

Differentiation

WPP excels in creative transformation, combining creativity with data and technology.

The company is a leader in sustainability, participating in global initiatives like the UN Climate Change Conference.

WPP's strategic partnerships, such as with Universal Music Group, enhance its unique market offerings.

Upsides

Increased focus on AI-driven marketing solutions enhances WPP's service offerings and client engagement.

Strategic partnerships with music industry leaders provide unique marketing opportunities and vast music access.

Winning the 'Omnichannel Excellence Award' highlights GroupM's leadership in integrated marketing solutions.

Land your dream remote job 3x faster with AI

Try Jobo Free