Associate Director, Data Engineering at S&P Global

New York, New York, United States

Apply Now

$127,000 – $185,000Compensation

Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level

Full TimeJob Type

UnknownVisa

Finance, Financial ServicesIndustries

Requirements

Bachelor’s degree in Computer Science, Information Systems, Engineering, or equivalent work experience
10+ years of IT experience in application support or development
Design & build ingestion pipelines using ETL/ELT and schema-on-read in data lake technologies
Experience in designing transactional systems, data warehouses, data lakes, and data integrations within a big data ecosystem, particularly leveraging cloud technologies
Provide technical expertise in the design and implementation of data ingestion pipelines with modern AWS cloud and other technologies such as S3, Hive, Databricks, Scala, Python, and large-scale data analytics tools
Strong experience in managing distributed data processing workloads, including configurations
Experience in working with multi-threaded, high-performance, low-latency messaging systems
Experience in AWS cloud-based technologies
Experience using system tools, source control systems, utilities, and third-party products
Excellent communication skills, with strong verbal and writing proficiencies
Proficiency in building data analytics solutions on AWS Cloud (preferred)
Thorough understanding of replication strategies and implementation of high-availability protocols for 99.99% uptime (preferred)
Experience with implementation of data governance and data lineage (preferred)
Proficiency in implementing data models in SQL and NoSQL databases (preferred)
Experience with financial applications such as Index/Benchmarks, Asset Management, Portfolio Investment modeling, or trading systems (preferred)
Experience with microservice and serverless architecture implementation (preferred)
Expertise in Databricks/AWS EMR and distributed big data processing technologies
Solid financial applications experience

Responsibilities

Lead the design and implementation of distributed data processing workloads using Python, including data access from relational databases and cloud storage technologies
Ensure performance, security, and reliability; coordinate with application teams to define database design
Collaborate with cross-functional teams to support data-driven initiatives
Mentor junior team members and promote best practices
Oversee maintenance and troubleshooting of distributed data processing systems
Drive innovation by evaluating and integrating new technologies
Produce system design documents and participate in technical walkthroughs
Perform application and system performance tuning and troubleshoot performance issues
Effectively interact with global customers, business users, and IT staff
Assist in day-to-day support and operations functions, design, development, and unit testing
Actively evaluate new products and technologies to build solutions that streamline business operations

Skills

Key technologies and capabilities for this role

PythonDatabricksAWS EMRSparkSQLBig Data ProcessingCloud StorageData PipelinesPerformance Tuning

Questions & Answers

Common questions about this position

What is the salary range for the Associate Director, Data Engineering role?

The anticipated base salary range is $127,000 - $185,000, with the final amount based on geographic location, experience, skill set, training, licenses, and certifications. This role is also eligible for an annual incentive plan.

What benefits are offered for this position?

This role is eligible to receive additional S&P Global benefits, in addition to base compensation and an annual incentive plan.

Is this a remote position or does it require office work?

This information is not specified in the job description.

What key skills and experience are required for this role?

Candidates need a Bachelor’s degree in Computer Science or equivalent, 10+ years of IT experience, expertise in Databricks/AWS EMR, Python, ETL/ELT pipelines, data lakes, AWS technologies like S3 and Hive, and managing distributed data processing workloads.

What does a strong candidate for this position look like?

A strong candidate is a seasoned technologist with 10+ years of experience in data engineering, expertise in Databricks, AWS, Python, and big data technologies, plus the ability to lead design, mentor juniors, and drive innovation.

S&P Global

Provides financial information and analytics services

About S&P Global

S&P Global provides financial information and analytics to a wide range of clients, including investors, corporations, and governments. The company offers services such as credit ratings, market intelligence, and indices, which help clients understand and navigate the global financial market. S&P Global's products work by utilizing advanced data analytics and research to deliver insights that assist clients in making informed decisions and managing risks. Unlike many competitors, S&P Global has a diverse range of divisions, including S&P Global Ratings and S&P Dow Jones Indices, which allows it to cater to various financial needs. The company's goal is to support clients in driving growth while also committing to corporate responsibility and positive societal impact.

New York City, New YorkHeadquarters

1917Year Founded

IPOCompany Stage

Data & Analytics, Financial ServicesIndustries

10,001+Employees

Benefits

Health Insurance

Unlimited Paid Time Off

Professional Development Budget

401(k) Company Match

Family Planning Benefits

Employee Discounts

Risks

Integration challenges with new acquisitions like ProntoNLP may cause operational issues.

Increased competition from AI-driven platforms like Brooklyn Investment Group.

Dependence on volatile credit ratings market could impact revenue stability.

Differentiation

S&P Global integrates advanced AI tools for superior financial analytics capabilities.

The company offers comprehensive ESG solutions, meeting growing sustainability demands.

S&P Global's diverse divisions provide a wide range of financial services globally.

Upsides

Acquisition of ProntoNLP boosts data analytics and sentiment scoring capabilities.

Rising demand for ESG data enhances S&P Global's market position.

Expansion into India strengthens S&P Global's research and insights offerings.

Land your dream remote job 3x faster with AI

Try Jobo Free