DXC Technology

Python Pyspark Data Engineer

Bengaluru, Karnataka, India

Not SpecifiedCompensation
Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level
Full TimeJob Type
UnknownVisa
Information Technology, IT Services, ConsultingIndustries

Lead Data Engineer - Python Pyspark

Employment Type: Full-time

Job Locations: Hyderabad / Bangalore / Chennai / Kolkata / Noida / Gurgaon / Pune / Indore / Mumbai


Position Overview

We are seeking a skilled Lead Data Engineer with strong programming and SQL skills to join our team. The ideal candidate will have hands-on experience with Python and Pyspark Data Analytics services and a basic understanding of general AWS services.


Key Responsibilities

  • Design, develop, and optimize data pipelines using Python, Pyspark, and AWS Data Analytics services such as RDS, DMS, Glue, Lambda, Redshift, and Athena.
  • Implement data migration and transformation processes using AWS DMS and Glue.
  • Work with SQL (Oracle & Postgres) to query, manipulate, and analyze large datasets.
  • Develop and maintain ETL/ELT workflows for data ingestion and transformation.
  • Utilize AWS services like S3, IAM, CloudWatch, and VPC to ensure secure and efficient data operations.
  • Write clean and efficient Python scripts for automation and data processing.
  • Collaborate with DevOps teams using Azure DevOps for CI/CD pipelines and infrastructure management.
  • Monitor and troubleshoot data workflows to ensure high availability and performance.

Company Information

At DXC Technology, we believe strong connections and community are key to our success. Our work model prioritizes in-person collaboration while offering flexibility to support wellbeing, productivity, individual work styles, and life circumstances. We’re committed to fostering an inclusive environment where everyone can thrive.


Important Notice Regarding Recruitment Fraud

Recruitment fraud is a scheme in which fictitious job opportunities are offered to job seekers typically through online services, such as false websites, or through unsolicited emails claiming to be from the company. These emails may request recipients to provide personal information or to make payments as part of their illegitimate recruiting process.

DXC does not make offers of employment via social media networks and DXC never asks for any money or payments from applicants at any point in the recruitment process, nor ask a job seeker to purchase IT or other equipment on our behalf.

More information on employment scams is available here.

Skills

Python
Pyspark
SQL
AWS
RDS
DMS
Glue
Lambda
Redshift
Athena
S3
IAM
CloudWatch
VPC
ETL
ELT
Data Pipelines
Data Migration
Data Transformation
Automation
CI/CD
Azure DevOps
Oracle
Postgres

DXC Technology

IT services for enterprise modernization and management

About DXC Technology

DXC Technology provides IT services to large enterprises, focusing on modernizing their critical systems and operations. The company uses the Enterprise Technology Stack to enhance IT infrastructure, optimize data architectures, and ensure security across various cloud environments, including public, private, and hybrid. DXC operates on a contractual basis, offering consulting, system integration, and managed services to help clients improve their IT operations. What sets DXC apart from competitors is its strong commitment to innovation, sustainability, and corporate responsibility, which has earned it recognition as one of the Most Responsible Companies. The goal of DXC Technology is to be a trusted partner for enterprises, helping them achieve scalable and secure IT solutions while promoting inclusion and diversity within its workforce.

McLean, VirginiaHeadquarters
2017Year Founded
$14.6MTotal Funding
IPOCompany Stage
Consulting, Enterprise SoftwareIndustries
10,001+Employees

Risks

Emerging IT service providers offer cost-effective solutions, threatening DXC's market share.
Rapid technological changes may outpace DXC's innovation, risking service obsolescence.
Economic downturns could reduce IT spending, impacting DXC's long-term contract revenue.

Differentiation

DXC Technology is a Fortune 500 global IT services leader.
The company specializes in modernizing mission-critical systems for large enterprises.
DXC's Enterprise Technology Stack ensures security and scalability across cloud environments.

Upsides

DXC is recognized as a leader in the 2024 Magic Quadrant for Outsourced Digital Workplace Services.
The Quercus AI platform collaboration with Ferrovial and Microsoft enhances DXC's innovation capabilities.
DXC's role in transforming Italy's healthcare sector showcases its expertise in digital transformation.

Land your dream remote job 3x faster with AI