Data Engineer - Databricks at DXC Technology

Newcastle, England, United Kingdom

Apply Now

Not SpecifiedCompensation

Mid-level (3 to 4 years), Senior (5 to 8 years)Experience Level

Full TimeJob Type

NoVisa

TechnologyIndustries

Requirements

Sole UK national status and willing to undergo SC clearance
Willing to travel within the UK when required
Proven experience with Databricks and its ecosystem
Strong proficiency in PySpark, especially with UDFs and Pandas UDFs
Hands-on experience with dbt and Airflow
Databricks Certified Data Engineer Associate certification or willingness to achieve one
Excellent problem-solving skills and a passion for data and AI
Bachelor's degree in a relevant field or equivalent combination of education and experience
Typically, 6+ years of relevant work experience in industry, with a minimum of 2+ years in a similar role
Proficiencies in data cleansing, exploratory data analysis, and data visualization
Continuous learner that stays abreast with industry knowledge and technology

Responsibilities

Build and maintain scalable data pipelines using Databricks
Manage and optimize Databricks Workspace, Clusters, Jobs, Repos, and Delta Live Tables
Develop modular ETL workflows using dbt and orchestrate them with Apache Airflow
Write advanced PySpark code, including UDFs and Pandas UDFs, for efficient data processing
Ensure data quality, reliability, and performance across all systems
Collaborate with data scientists, analysts, and engineers to deliver data solutions that support business goals
Contribute to the mentoring and development of junior team members
Support senior team members in identifying and addressing data science opportunities

Skills

Key technologies and capabilities for this role

DatabricksPySparkdbtAirflowDelta Live TablesETLPandas UDFsUDFs

Questions & Answers

Common questions about this position

What is the salary for this Data Engineer role?

The salary is competitive plus benefits.

Is remote work available for this position?

Hybrid options are available, with locations in Newcastle, UK or Erskine, Scotland. The work model prioritizes in-person collaboration while offering flexibility.

What skills are required for this Databricks Data Engineer role?

Required skills include proven experience with Databricks, strong proficiency in PySpark (especially UDFs and Pandas UDFs), hands-on experience with dbt and Airflow, and Databricks Certified Data Engineer Associate certification or willingness to achieve it. Excellent problem-solving skills and 6+ years of relevant experience are also needed.

What is the company culture like at DXC Technology?

The culture is inclusive, supportive, collaborative, and innovative, with a focus on strong connections, community, and fostering an environment where everyone can thrive.

What makes a strong candidate for this role?

Strong candidates have sole UK national status, are willing to undergo SC clearance and travel within the UK, possess 6+ years of experience with 2+ in a similar role, hold a relevant degree, and show a passion for continuous learning in data and AI.

DXC Technology

IT services for enterprise modernization and management

About DXC Technology

DXC Technology provides IT services to large enterprises, focusing on modernizing their critical systems and operations. The company uses the Enterprise Technology Stack to enhance IT infrastructure, optimize data architectures, and ensure security across various cloud environments, including public, private, and hybrid. DXC operates on a contractual basis, offering consulting, system integration, and managed services to help clients improve their IT operations. What sets DXC apart from competitors is its strong commitment to innovation, sustainability, and corporate responsibility, which has earned it recognition as one of the Most Responsible Companies. The goal of DXC Technology is to be a trusted partner for enterprises, helping them achieve scalable and secure IT solutions while promoting inclusion and diversity within its workforce.

McLean, VirginiaHeadquarters

2017Year Founded

$14.6MTotal Funding

IPOCompany Stage

Consulting, Enterprise SoftwareIndustries

10,001+Employees

Risks

Emerging IT service providers offer cost-effective solutions, threatening DXC's market share.

Rapid technological changes may outpace DXC's innovation, risking service obsolescence.

Economic downturns could reduce IT spending, impacting DXC's long-term contract revenue.

Differentiation

DXC Technology is a Fortune 500 global IT services leader.

The company specializes in modernizing mission-critical systems for large enterprises.

DXC's Enterprise Technology Stack ensures security and scalability across cloud environments.

Upsides

DXC is recognized as a leader in the 2024 Magic Quadrant for Outsourced Digital Workplace Services.

The Quercus AI platform collaboration with Ferrovial and Microsoft enhances DXC's innovation capabilities.

DXC's role in transforming Italy's healthcare sector showcases its expertise in digital transformation.

Land your dream remote job 3x faster with AI

Try Jobo Free