Principal Engineer, Data Analytics Engineering (Data Engineering , GenAI , Python , SQL) ,8 + years at Western Digital

Bengaluru, Karnataka, India

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level

Full TimeJob Type

UnknownVisa

Technology, Data StorageIndustries

Requirements

Bachelor’s or Master’s degree in Computer Science, Data Engineering, AI/ML, or related field
9+ years of experience in data engineering, AI/ML systems, and cloud computing
Proven expertise with AWS cloud ecosystem (S3, Glue, Redshift, EMR, Lambda, SageMaker, Bedrock) and Databricks
Hands-on experience with Generative AI models (LLMs, diffusion models), frameworks (LangChain, Hugging Face, OpenAI/Anthropic APIs), and RAG implementations
Strong programming skills in Python, SQL, and at least one compiled language (Java, Scala, or Go)
Experience with modern data engineering tools and pipelines (Airflow, Spark, Kafka, dbt, Snowflake)
Excellent problem-solving skills with experience in architecture design and stakeholder communication
(Preferred) Experience with vector and graph databases (e.g., Pinecone, Weaviate, pgvector, Neo4j)
(Preferred) Working knowledge of MCP (Model Context Protocol) for orchestrating and managing AI agent workflows
(Preferred) Familiarity with containerization and orchestration (Docker, Kubernetes, EKS)
(Preferred) Knowledge of MLOps/LLMOps practices and CI/CD pipelines for AI workloads (e.g., MLflow, Kubeflow, LangSmith)
(Preferred) Strong understanding of data security, compliance, and governance in cloud and AI systems

Responsibilities

AI Platform Architecture: Design and implement scalable AI/ML and GenAI solutions on AWS using modern data engineering frameworks and best practices
Data Engineering Leadership: Drive the development of robust data pipelines, ETL/ELT frameworks, and data models that support AI/ML and analytics use cases at scale
Generative AI Solutions: Lead the exploration, prototyping, and deployment of GenAI applications (LLM-based copilots, RAG pipelines, autonomous agents) across enterprise scenarios
Technology Strategy: Evaluate and adopt emerging technologies to strengthen AI and data engineering efficiency and capabilities
Cloud & Infrastructure: Define and implement cloud-native architectures using AWS services (S3, Glue, Redshift, EMR, Lambda, SageMaker, Bedrock, EKS)
Collaboration & Influence: Partner with data scientists, product managers, and business stakeholders to translate business needs into scalable technical solutions
Best Practices & Governance: Establish coding standards, DevOps/MLOps practices, and enforce data governance and security controls for AI workloads
Mentorship & Leadership: Guide and mentor engineers and data professionals, fostering innovation, technical excellence, and best practices

Skills

Key technologies and capabilities for this role

PythonSQLData EngineeringGenAIAWSS3GlueRedshiftEMRLambdaSageMakerBedrockEKSETLELTLLMRAGML

Questions & Answers

Common questions about this position

What is the work location for this position?

The position is on-site.

What salary or compensation is offered for this role?

This information is not specified in the job description.

What are the key skills required for this Principal AI Engineer role?

Required skills include 9+ years in data engineering, AI/ML systems, and cloud computing; proven expertise with AWS services like S3, Glue, Redshift, EMR, Lambda, SageMaker, Bedrock and Databricks; hands-on experience with Generative AI models, frameworks like LangChain, Hugging Face, and RAG; and strong programming in Python, SQL, and Java/Scala/Go.

What leadership responsibilities does this role involve?

The role includes data engineering leadership, mentorship of engineers and data professionals, collaboration with data scientists and stakeholders, and establishing best practices, governance, and technical excellence.

What qualifications make a strong candidate for this position?

A Bachelor’s or Master’s in Computer Science, Data Engineering, AI/ML or related field, plus 9+ years of experience in data engineering, AI/ML, cloud computing, AWS expertise, Generative AI hands-on experience, and strong Python/SQL programming skills.

Western Digital

Provides data storage solutions and services

About Western Digital

Western Digital provides a variety of data storage solutions, including Network Attached Storage (NAS), Storage Area Network (SAN), private cloud, and hyper-converged infrastructure. Their products are designed to help businesses manage and store data efficiently and reliably. For example, their all-flash arrays are optimized for high input/output applications, while the JetStor brand offers cost-effective NAS and SAN arrays that support multiple host ports for improved performance. What sets Western Digital apart from its competitors is its extensive experience in the data storage market and its ability to cater to a wide range of clients, from large corporations to small businesses. The company's goal is to deliver high-value storage solutions that meet the diverse needs of its customers, ensuring they have the tools necessary for effective data management.

San Jose, CaliforniaHeadquarters

2014Year Founded

$927.9MTotal Funding

IPOCompany Stage

Data & Analytics, Enterprise SoftwareIndustries

10,001+Employees

Benefits

Paid sick leave & vacation time

Medical/dental/vision insurance

Life, accident, & disability insurance

Tax-advantaged flexible spending and health savings accounts

Employee assistance program

Tuition reimbursement

Employee stock purchase plan

Western Digital Savings 401(k) Plan

Risks

Seagate's HAMR technology may outperform Western Digital's ePMR in high-capacity HDDs.

Toshiba's HAMR and MAMR technologies intensify competition in the storage market.

Focus on consumer products may neglect enterprise client needs, risking market share.

Differentiation

Western Digital leads in high-capacity HDDs with 32TB UltraSMR and ePMR technology.

The company offers diverse storage solutions, including NAS, SAN, and private cloud.

Western Digital's SanDisk and WD_BLACK brands target creators and gamers effectively.

Upsides

Growing demand for high-capacity storage driven by AI and data-intensive applications.

Recent product launches cater to the expanding gaming and content creation markets.

Advancements in ePMR technology enhance Western Digital's competitive edge in HDDs.

Land your dream remote job 3x faster with AI

Try Jobo Free