Data Engineer - Databricks at DXC Technology

Newcastle, England, United Kingdom

Apply Now

Not SpecifiedCompensation

Mid-level (3 to 4 years), Senior (5 to 8 years)Experience Level

Full TimeJob Type

NoVisa

TechnologyIndustries

Requirements

Sole UK national status and willing to undergo SC clearance
Willing to travel within the UK when required
Proven experience with Databricks and its ecosystem
Strong proficiency in PySpark, especially with UDFs and Pandas UDFs
Hands-on experience with dbt and Airflow
Databricks Certified Data Engineer Associate certification or willingness to achieve one
Excellent problem-solving skills and a passion for data and AI
Bachelor's degree in a relevant field or equivalent combination of education and experience
Typically, 6+ years of relevant work experience in industry, with a minimum of 2+ years in a similar role
Proficiencies in data cleansing, exploratory data analysis, and data visualization
Continuous learner that stays abreast with industry knowledge and technology

Responsibilities

Build and maintain scalable data pipelines using Databricks
Manage and optimize Databricks Workspace, Clusters, Jobs, Repos, and Delta Live Tables
Develop modular ETL workflows using dbt and orchestrate them with Apache Airflow
Write advanced PySpark code, including UDFs and Pandas UDFs, for efficient data processing
Ensure data quality, reliability, and performance across all systems
Collaborate with data scientists, analysts, and engineers to deliver data solutions that support business goals
Contribute to the mentoring and development of junior team members
Support senior team members in identifying and addressing data science opportunities

Skills

Databricks

PySpark

dbt

Airflow

Delta Live Tables

ETL

Pandas UDFs

UDFs

DXC Technology

IT services for enterprise modernization and management

About DXC Technology

DXC Technology provides IT services to large enterprises, focusing on modernizing their critical systems and operations. The company uses the Enterprise Technology Stack to enhance IT infrastructure, optimize data architectures, and ensure security across various cloud environments, including public, private, and hybrid. DXC operates on a contractual basis, offering consulting, system integration, and managed services to help clients improve their IT operations. What sets DXC apart from competitors is its strong commitment to innovation, sustainability, and corporate responsibility, which has earned it recognition as one of the Most Responsible Companies. The goal of DXC Technology is to be a trusted partner for enterprises, helping them achieve scalable and secure IT solutions while promoting inclusion and diversity within its workforce.

McLean, VirginiaHeadquarters

2017Year Founded

$14.6MTotal Funding

IPOCompany Stage

Consulting, Enterprise SoftwareIndustries

10,001+Employees

Risks

Emerging IT service providers offer cost-effective solutions, threatening DXC's market share.

Rapid technological changes may outpace DXC's innovation, risking service obsolescence.

Economic downturns could reduce IT spending, impacting DXC's long-term contract revenue.

Differentiation

DXC Technology is a Fortune 500 global IT services leader.

The company specializes in modernizing mission-critical systems for large enterprises.

DXC's Enterprise Technology Stack ensures security and scalability across cloud environments.

Upsides

DXC is recognized as a leader in the 2024 Magic Quadrant for Outsourced Digital Workplace Services.

The Quercus AI platform collaboration with Ferrovial and Microsoft enhances DXC's innovation capabilities.

DXC's role in transforming Italy's healthcare sector showcases its expertise in digital transformation.

Land your dream remote job 3x faster with AI

Try Jobo Free