Job Description: Python PySpark Data Engineer

Employment Type: Full-time

Location: Hyderabad / Bangalore / Chennai / Kolkata / Noida / Gurgaon / Pune / Indore / Mumbai

---

Position Overview

We are seeking a skilled Python PySpark Data Engineer to join our team. The ideal candidate will have strong Python skills, experience in data pipeline development, and a solid understanding of database technologies. This role involves designing, building, and maintaining scalable data pipelines and ETL workflows.

---

Requirements

• Strong Python Skills: Proficient in Python for data manipulation, automation, and building reusable components.
• Data Pipeline Development: Experience designing and maintaining ETL/data pipelines using tools like Airflow or custom scripts.
• Database Knowledge: Hands-on experience with SQL and NoSQL databases such as PostgreSQL, MySQL, and MongoDB.
• Data Analysis: Skilled in data wrangling and analysis using Pandas, NumPy, and similar libraries.
• ETL Expertise: Capable of building scalable ETL workflows for large structured and unstructured datasets.
• Cloud Platform Exposure: Familiarity with AWS, Azure, or GCP for data storage, processing, and deployment.
• API Integration: Experience consuming and integrating RESTful APIs for data exchange.
• Big Data Tools (Preferred): Exposure to PySpark, Hadoop, or Kafka for handling large-scale data.
• CI/CD & DevOps: Proficient with Git, Jenkins, and Docker for code versioning and automated deployment.

---

Responsibilities

• Design, develop, and maintain robust data pipelines.
• Implement ETL processes for structured and unstructured data.
• Collaborate with teams to integrate data from various sources.
• Utilize cloud platforms for data storage and processing.
• Ensure efficient data exchange through API integrations.
• Contribute to CI/CD practices for deployment automation.

---

Company Information

At DXC Technology, we believe strong connections and community are key to our success. Our work model prioritizes in-person collaboration while offering flexibility to support wellbeing, productivity, individual work styles, and life circumstances. We’re committed to fostering an inclusive environment where everyone can thrive.

---

Recruitment Fraud Advisory

Please be aware of recruitment fraud. DXC Technology does not make offers of employment via social media networks and never asks for any money or payments from applicants at any point in the recruitment process, nor asks a job seeker to purchase IT or other equipment on our behalf. More information on employment scams is available here.