Lead Software Engineer-Data Engineering at Caterpillar Inc.

Chennai, Tamil Nadu, India

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level

Full TimeJob Type

UnknownVisa

Technology, Manufacturing, DigitalIndustries

Requirements

Proven experience in Big Data processing and Data Warehousing
Expertise in building end-to-end near real-time data pipelines for OLTP & OLAP
Strong architecture exposure for building robust, scalable Data Platforms
Deep expertise in Snowflake, SQL, NoSQL, and distributed data systems
Experience with data transformation tools (dbt, Apache Spark, Azure Data Factory)
Strong analytical skills and solid knowledge of computer science fundamentals
Deep exposure to Azure and AWS cloud platforms
Good understanding of AI concepts and latest developments (Gen AI, MCP, ATA, etc.)
Knowledge of the NVIDIA e (nice-to-have)

Responsibilities

Lead, mentor, and manage a team of data engineers and platform developers
Foster a culture of technical excellence, collaboration, and continuous learning
Drive Agile practices and ensure timely delivery of high-quality solutions
Architect and oversee the development of scalable, secure, and resilient data platforms
Design and implement near real-time data movement and streaming architectures using tools like Kafka, Spark, and cloud-native services
Establish best practices in data modelling, ETL/ELT, data governance, and metadata management
Lead the development of robust data pipelines for ingestion, transformation, and delivery using Snowflake, dbt, and cloud-native tools
Optimize data storage, retrieval, and processing for performance, reliability, and cost-efficiency
Implement data quality frameworks, lineage tracking, and schema evolution strategies
Build and maintain large-scale data lakes and data warehouses for structured and unstructured data
Design scalable data architectures to support manufacturing analytics, predictive maintenance, and supply chain optimization
Leverage Azure and AWS services for data ingestion, transformation, and analytics
Deploy software using CI/CD tools (Azure DevOps preferred, Jenkins, AWS CloudFormation)
Ensure platform scalability, security, and operational readiness across global deployments
Collaborate with Data Science and AI teams to operationalize ML models and analytics workflows
Promote integration of AI capabilities into data engineering pipelines (e.g., GenAI, MCP, ATA)
Support real-time analytics and edge AI use cases in manufacturing environments
Partner with product managers, manufacturing SMEs, and business leaders to understand requirements and deliver impactful data solutions
Communicate technical concepts to non-technical audiences and influence strategic decisions

Skills

Snowflake

Big Data

Data Warehousing

Kafka

Spark

ETL

ELT

Data Modelling

Data Governance

Data Pipelines

Streaming

Agile

Cloud-Native

Caterpillar Inc.

Manufactures heavy machinery for various industries

About Caterpillar Inc.

Caterpillar Inc. designs and manufactures heavy machinery and equipment for industries such as construction, mining, energy, and rail. Their products include a wide range of machinery and engines that help clients complete large-scale projects. Caterpillar's equipment works by providing powerful tools that can perform tasks like digging, lifting, and transporting materials. What sets Caterpillar apart from its competitors is its strong aftermarket support, which includes maintenance and repair services, ensuring that their machinery remains efficient and reliable over time. The company's goal is to deliver high-quality products while also focusing on sustainability and community development through initiatives that improve education and reduce poverty.

Irving, TexasHeadquarters

1925Year Founded

$143.5KTotal Funding

IPOCompany Stage

Industrial & Manufacturing, Social Impact, AI & Machine LearningIndustries

10,001+Employees

Benefits

Annual incentive bonus plan

Medical, dental, and vision coverage

Paid time off plan (Vacation, Holiday, Volunteer, Etc.)

401k savings plan

Health savings account (HSA)

Flexible spending accounts (FSAs)

Disability benefits

Life Insurance

Parental leave

Healthy Lifestyle Programs

Employee Assistance Programs

Voluntary Benefits and Employee Discounts

Tuition Reimbursement

Career Development

Risks

Closure of Aurora office may impact regional economy and Caterpillar's reputation.

Partnership with Anti Social Social Club could dilute Caterpillar's industrial brand focus.

Advanced technology in Cat D8 dozer may face resistance from traditional customers.

Differentiation

Caterpillar's century-long history underscores its reliability and industry leadership.

The company integrates AI and IoT to enhance machinery performance and customer satisfaction.

Caterpillar's strong aftermarket services ensure product longevity and operational efficiency.

Upsides

Growing demand for autonomous equipment boosts Caterpillar's innovation in heavy machinery.

Expansion of 5G networks enhances Caterpillar's remote operation capabilities, improving safety.

Caterpillar's commitment to sustainability aligns with the global shift towards eco-friendly practices.

Land your dream remote job 3x faster with AI

Try Jobo Free