Lead Databricks Engineer / Architect at DXC Technology

Bengaluru, Karnataka, India

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level

Full TimeJob Type

UnknownVisa

TechnologyIndustries

Requirements

10+ years of total IT experience, with at least 5 years of relevant data engineering experience on Databricks
Strong expertise in Databricks (Workspace, Clusters, Jobs, Repos, Delta Live Tables)
Strong expertise in PySpark (UDFs & Pandas UDFs)
Strong expertise in dbt for data transformations
Strong expertise in Apache Airflow for orchestration
Solid understanding of cloud data platforms (Azure/AWS/GCP)
Hands-on with CI/CD, version control (Git), and DevOps practices for data engineering
Databricks Certified Data Engineer Associate (mandatory)
Proven ability to lead and mentor teams
Excellent communication and stakeholder management skills

Responsibilities

Lead the design and implementation of data lakehouse architectures using Databricks, Delta Lake, and Delta Live Tables
Define best practices for workspace setup, cluster management, repos, and job orchestration
Partner with stakeholders to translate business needs into scalable data engineering solutions
Develop and optimize ETL/ELT pipelines using PySpark, dbt, and Airflow
Implement advanced PySpark transformations leveraging UDFs and Pandas UDFs for complex use cases
Ensure data quality, lineage, and observability across all pipelines

Skills

Databricks

PySpark

UDFs

Pandas UDFs

dbt

Apache Airflow

Delta Lake

Delta Live Tables

Git

CI/CD

Azure

AWS

GCP

DXC Technology

IT services for enterprise modernization and management

About DXC Technology

DXC Technology provides IT services to large enterprises, focusing on modernizing their critical systems and operations. The company uses the Enterprise Technology Stack to enhance IT infrastructure, optimize data architectures, and ensure security across various cloud environments, including public, private, and hybrid. DXC operates on a contractual basis, offering consulting, system integration, and managed services to help clients improve their IT operations. What sets DXC apart from competitors is its strong commitment to innovation, sustainability, and corporate responsibility, which has earned it recognition as one of the Most Responsible Companies. The goal of DXC Technology is to be a trusted partner for enterprises, helping them achieve scalable and secure IT solutions while promoting inclusion and diversity within its workforce.

McLean, VirginiaHeadquarters

2017Year Founded

$14.6MTotal Funding

IPOCompany Stage

Consulting, Enterprise SoftwareIndustries

10,001+Employees

Risks

Emerging IT service providers offer cost-effective solutions, threatening DXC's market share.

Rapid technological changes may outpace DXC's innovation, risking service obsolescence.

Economic downturns could reduce IT spending, impacting DXC's long-term contract revenue.

Differentiation

DXC Technology is a Fortune 500 global IT services leader.

The company specializes in modernizing mission-critical systems for large enterprises.

DXC's Enterprise Technology Stack ensures security and scalability across cloud environments.

Upsides

DXC is recognized as a leader in the 2024 Magic Quadrant for Outsourced Digital Workplace Services.

The Quercus AI platform collaboration with Ferrovial and Microsoft enhances DXC's innovation capabilities.

DXC's role in transforming Italy's healthcare sector showcases its expertise in digital transformation.

Land your dream remote job 3x faster with AI

Try Jobo Free