Data Lake SME at Hewlett Packard Enterprise

Bengaluru, Karnataka, India

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

TechnologyIndustries

Requirements

7+ years of experience in data engineering, ETL/ELT development, or data lake management
Strong expertise in ETL tools (Informatica, Talend, dbt, SSIS, or similar)
Hands-on experience with big data ecosystems: Hadoop, Spark, Hive, Presto, Delta Lake, or Iceberg
Proficiency with SQL, Python, or Scala for data processing and transformation
Experience with cloud data platforms (AWS Glue, Redshift, Azure Synapse, GCP BigQuery)
Familiarity with workflow orchestration tools (Airflow, Temporal, Oozie)
Bachelor’s or Master’s degree in Computer Science (or related field)
Preferred Knowledge
Exposure to real-time data streaming (Kafka, Kinesis, Pulsar)
Knowledge of data modeling (Kimball/Inmon), star schema, and dimensional modeling
Experience with containerized deployments (Docker, Kubernetes)

Responsibilities

Design and implement data ingestion pipelines for structured, semi-structured, and unstructured data
Develop and manage ETL/ELT processes for large-scale data processing
Optimize storage and retrieval strategies across on-prem and cloud-based data lakes
Integrate data from multiple sources (databases, APIs, streaming platforms)
Implement real-time and batch processing using Apache Spark, Kafka, or Flink
Support metadata management, data lineage, and cataloging
Tune queries and pipelines for high performance and cost efficiency
Implement partitioning, indexing, and caching strategies for large datasets
Automate routine ETL/ELT workflows for reliability and speed
Ensure compliance with data governance, privacy, and regulatory standards (GDPR, HIPAA, etc.)
Implement encryption, masking, and role-based access control (RBAC)
Collaborate with cybersecurity teams to align with Zero Trust and IAM policies
Partner with data scientists, analysts, and application teams for analytics enablement
Provide L2/L3 support for production pipelines and troubleshoot failures
Mentor junior engineers and contribute to best practices documentation

Skills

Data Lake

ETL

ELT

Data Ingestion

Data Pipelines

Data Transformation

Analytics Pipelines

Data Governance

Data Quality

Hewlett Packard Enterprise

Provides enterprise IT solutions and services

About Hewlett Packard Enterprise

Hewlett Packard Enterprise provides enterprise IT solutions with a focus on cloud services, artificial intelligence, and edge computing. Their products include HPE Ezmeral for managing containers, HPE GreenLake for cloud services, and HPE Aruba for networking. These solutions help businesses improve their performance and adapt to digital changes. HPE's business model includes selling hardware, software, and services, as well as offering subscription-based services and long-term contracts. What sets HPE apart from competitors is its commitment to open-source projects and its active developer community, which supports collaboration and innovation. The company's goal is to empower organizations to transform digitally and optimize their operations.

Houston, TexasHeadquarters

1939Year Founded

IPOCompany Stage

Hardware, Enterprise Software, AI & Machine LearningIndustries

10,001+Employees

Risks

Integration challenges with Juniper Networks may delay AI-driven networking benefits.

Competition from startups like Flywheel could impact HPE's AI and cloud services.

HPE's acquisition strategy may strain resources and distract from core operations.

Differentiation

HPE's GreenLake offers a unique hybrid cloud platform for diverse IT environments.

HPE Ezmeral provides advanced container management, enhancing enterprise AI and analytics capabilities.

HPE's Aruba solutions integrate cloud security and networking for seamless, secure connectivity.

Upsides

HPE's acquisition of Juniper Networks boosts AI-driven innovation in networking.

OpsRamp acquisition enhances HPE's IT management with AI-based automation capabilities.

Axis Security integration strengthens HPE's cloud security offerings with SASE solutions.

Land your dream remote job 3x faster with AI

Try Jobo Free