Data Engineer (Databricks) at Accenture

Mississauga, Ontario, Canada

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level

Full TimeJob Type

UnknownVisa

Technology, ConsultingIndustries

Requirements

Experienced, hands-on Data & AI Engineer with deep expertise in Databricks and Azure data services
Ability to design, build, and optimize scalable data pipelines
Work closely with analytics, data science, and cloud teams
Availability for 3 days per week at the local Mississauga office or a client site in the Greater Toronto Area
Preferred locations: Toronto and Mississauga

Responsibilities

Architect, develop, and maintain scalable, low-latency data pipelines to ingest and transform diverse datasets leveraging Azure Databricks workflows and Spark technologies
Design and optimize lakehouse architecture using Delta Lake tables following Bronze, Silver, and Gold layers to ensure efficient, reliable, and governed data storage
Partner closely with data scientists and business analysts to deliver clean, validated, and well-modeled datasets that support advanced analytics and AI initiatives
Continuously monitor pipeline health and performance; implement automated alerting and observability frameworks to facilitate rapid troubleshooting and proactive optimization
Develop and enforce comprehensive data quality, validation, and security frameworks aligned with GDPR, CCPA, and other regulatory requirements
Lead initiatives to optimize compute and cost efficiency through containerized Spark job orchestration and serverless compute resource management on Azure
Govern data assets through unified policies via Unity Catalog and Azure Active Directory for fine-grained access control and compliance assurance
Champion CI/CD best practices including automated deployments, version control with Git, and infrastructure-as-code for robust, repeatable data engineering workflows
Collaborate with Power BI teams to develop performant and scalable reporting solutions by connecting Databricks SQL endpoints to business

Skills

Key technologies and capabilities for this role

DatabricksAzureData EngineeringData PipelinesScalable Data SystemsData & AI

Questions & Answers

Common questions about this position

Is this a remote position or does it require office work?

This role requires 3 days per week at the local Mississauga office or a client site in the Greater Toronto Area, with preferred hiring locations in Toronto and Mississauga.

What key skills are required for this Data Engineer role?

The role requires deep hands-on expertise in Databricks and Azure data services, experience architecting scalable data pipelines using Azure Databricks workflows and Spark technologies, and designing lakehouse architecture with Delta Lake tables following Bronze, Silver, and Gold layers.

What is the salary or compensation for this position?

This information is not specified in the job description.

What is the company culture like at Accenture's Advanced Technology Centers?

The culture is highly collaborative, inclusive, and values diversity, with opportunities to work in a growing network of technology and data experts solving complex challenges, and nurturing talent in a boundaryless career environment.

What makes a strong candidate for this Lead Data Engineer role?

A strong candidate is an experienced, hands-on Data & AI Engineer with deep expertise in Databricks and Azure, skilled in designing scalable pipelines, lakehouse architecture, and partnering with data scientists and analysts.

Accenture

Global professional services for digital transformation

About Accenture

Accenture provides a wide range of professional services, including strategy and consulting, technology, and operations, to help organizations improve their performance. Their services assist clients in navigating digital transformation, enhancing operational efficiency, and achieving sustainable growth. Accenture's offerings include cloud migration, cybersecurity, artificial intelligence, and data analytics, which are tailored to meet the needs of various industries such as financial services, healthcare, and retail. What sets Accenture apart from its competitors is its extensive industry knowledge and ability to deliver comprehensive solutions that address both immediate challenges and long-term goals. The company's aim is to support clients in reducing their environmental impact while driving innovation and growth.

Dublin, IrelandHeadquarters

1989Year Founded

$8.5MTotal Funding

IPOCompany Stage

Consulting, Enterprise Software, CybersecurityIndustries

10,001+Employees

Risks

Rapid AI advancements may outpace Accenture's current capabilities, risking competitive disadvantages.

Integration challenges from multiple acquisitions could affect Accenture's operational efficiency.

The rise of AI-driven startups may disrupt Accenture's market share in customer service solutions.

Differentiation

Accenture's acquisitions enhance its capabilities in digital twin technology for financial services.

The company is expanding its expertise in net-zero infrastructure through strategic acquisitions.

Accenture's focus on software-defined vehicles positions it as a leader in automotive innovation.

Upsides

Accenture's investment in EMTECH supports central bank modernization amid digital currency evolution.

The acquisition of Award Solutions boosts Accenture's presence in the growing 5G and IoT markets.

Accenture's strategic acquisitions align with high-growth markets like digital twins and net-zero projects.

Land your dream remote job 3x faster with AI

Try Jobo Free