Senior Data Engineer AWS Cloud Development Expert at S&P Global

Bengaluru, Karnataka, India

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level

Full TimeJob Type

UnknownVisa

Financial ServicesIndustries

Requirements

7+ years of experience in data engineering or equivalent technical role
5+ years of hands-on experience with AWS Cloud Development and DevOps
Strong expertise in SQL, data modeling, and ETL/ELT pipelines
Deep experience with Oracle (PL/SQL, performance tuning, data extraction)
Proficiency in Python and/or Scala for data processing tasks
Strong knowledge of cloud infrastructure (networking, security, cost optimization)
Experience with infrastructure as code (Terraform)
Familiarity with CI/CD pipelines and DevOps tooling (e.g., Jenkins, GitHub Actions)
Preferred (Nice to Have)
Experience with Google Cloud Platform (GCP), Snowflake
Knowledge of containerization and orchestration tools (e.g., Docker, Kubernetes)
Experience with modern orchestration tools (e.g., Airflow, dbt)
Exposure to data cataloging, governance, and quality tools

Responsibilities

Design, build, and maintain scalable data pipelines and data products
Develop and optimize ELT/ETL processes using a variety of data tools and technologies
Support and evolve data models that drive operational and analytical workloads
Modernize legacy Oracle-based systems and migrate workloads to cloud-native platforms
Build, deploy, and manage cloud-native data solutions using AWS services (e.g., S3, Lambda, Glue, EMR, Redshift, Athena, Step Functions)
Implement CI/CD pipelines, IaC (e.g., Terraform or CloudFormation), and monitor cloud infrastructure for performance and cost optimization
Ensure data platform security, scalability, and resilience in the AWS cloud
Act as a subject matter expert on cloud-based data development and DevOps best practices
Mentor data engineers on AWS architecture, infrastructure as code, and cloud-first design patterns
Participate in code and architecture reviews, enforcing best practices and high-quality standards
Work closely with product managers, data analysts, software engineers, and other stakeholders to understand business needs and deliver end-to-end solutions
Support and evolve the roadmap for data platform modernization and new product delivery

Skills

Key technologies and capabilities for this role

AWSS3LambdaGlueEMRRedshiftAthenaStep FunctionsTerraformCloudFormationOracleELTETLCI/CDIaC

Questions & Answers

Common questions about this position

What experience level is required for this Senior Data Engineer role?

The role requires 7+ years of experience in data engineering or equivalent technical role, plus 5+ years of hands-on experience with AWS Cloud Development and DevOps.

What are the key technical skills needed for this position?

Key skills include strong expertise in SQL, data modeling, and ETL/ELT pipelines; deep experience with Oracle (PL/SQL, performance tuning, data extraction); proficiency in Python and/or Scala; and experience with AWS services, Terraform, and CI/CD pipelines.

Is this a remote position, or is there a required location?

This information is not specified in the job description.

What is the salary for this Senior Data Engineer role?

This information is not specified in the job description.

What does the role involve in terms of team collaboration and leadership?

The role includes mentoring data engineers on AWS architecture and cloud practices, participating in code and architecture reviews, and working closely with product managers, data analysts, software engineers, and other stakeholders.

S&P Global

Provides financial information and analytics services

About S&P Global

S&P Global provides financial information and analytics to a wide range of clients, including investors, corporations, and governments. The company offers services such as credit ratings, market intelligence, and indices, which help clients understand and navigate the global financial market. S&P Global's products work by utilizing advanced data analytics and research to deliver insights that assist clients in making informed decisions and managing risks. Unlike many competitors, S&P Global has a diverse range of divisions, including S&P Global Ratings and S&P Dow Jones Indices, which allows it to cater to various financial needs. The company's goal is to support clients in driving growth while also committing to corporate responsibility and positive societal impact.

New York City, New YorkHeadquarters

1917Year Founded

IPOCompany Stage

Data & Analytics, Financial ServicesIndustries

10,001+Employees

Benefits

Health Insurance

Unlimited Paid Time Off

Professional Development Budget

401(k) Company Match

Family Planning Benefits

Employee Discounts

Risks

Integration challenges with new acquisitions like ProntoNLP may cause operational issues.

Increased competition from AI-driven platforms like Brooklyn Investment Group.

Dependence on volatile credit ratings market could impact revenue stability.

Differentiation

S&P Global integrates advanced AI tools for superior financial analytics capabilities.

The company offers comprehensive ESG solutions, meeting growing sustainability demands.

S&P Global's diverse divisions provide a wide range of financial services globally.

Upsides

Acquisition of ProntoNLP boosts data analytics and sentiment scoring capabilities.

Rising demand for ESG data enhances S&P Global's market position.

Expansion into India strengthens S&P Global's research and insights offerings.

Land your dream remote job 3x faster with AI

Try Jobo Free