Python PySpark Data Engineer

Employment Type: Full-time

Location: Hyderabad / Bangalore / Chennai / Kolkata / Noida / Gurgaon / Pune / Indore / Mumbai

---

Position Overview

We are seeking a skilled Python PySpark Data Engineer to join our team. The ideal candidate will be proficient in Python and experienced in designing, developing, and maintaining robust data pipelines and ETL workflows. This role requires strong database knowledge, data analysis skills, and familiarity with cloud platforms and big data tools.

---

Requirements

• Strong Python Skills: Proficient in Python for data manipulation, automation, and building reusable components.
• Data Pipeline Development: Experience designing and maintaining ETL/data pipelines using tools like Airflow or custom scripts.
• Database Knowledge: Hands-on experience with SQL and NoSQL databases such as PostgreSQL, MySQL, and MongoDB.
• Data Analysis: Skilled in data wrangling and analysis using Pandas, NumPy, and similar libraries.
• ETL Expertise: Capable of building scalable ETL workflows for large structured and unstructured datasets.
• Cloud Platform Exposure: Familiarity with AWS, Azure, or GCP for data storage, processing, and deployment.
• API Integration: Experience consuming and integrating RESTful APIs for data exchange.
• Big Data Tools (Preferred): Exposure to PySpark, Hadoop, or Kafka for handling large-scale data.
• CI/CD & DevOps: Proficient with Git, Jenkins, and Docker for code versioning and automated deployment.

---

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL processes.
• Perform data wrangling and analysis using Python libraries.
• Integrate and manage data from various SQL and NoSQL databases.
• Utilize cloud platforms for data storage and processing.
• Integrate RESTful APIs for data exchange.
• Implement CI/CD practices for automated deployment.

---

Company Information

At DXC Technology, we believe strong connections and community are key to our success. Our work model prioritizes in-person collaboration while offering flexibility to support wellbeing, productivity, individual work styles, and life circumstances. We’re committed to fostering an inclusive environment where everyone can thrive.

---

Recruitment Fraud Alert

Recruitment fraud is a scheme in which fictitious job opportunities are offered to job seekers typically through online services, such as false websites, or through unsolicited emails claiming to be from the company. These emails may request recipients to provide personal information or to make payments as part of their illegitimate recruiting process.

DXC does not make offers of employment via social media networks and DXC never asks for any money or payments from applicants at any point in the recruitment process, nor ask a job seeker to purchase IT or other equipment on our behalf. More information on employment scams is available here.