Data Engineer at RPS North America

New York, New York, United States

Apply Now

$133,120 – $156,000Compensation

Mid-level (3 to 4 years)Experience Level

Full TimeJob Type

UnknownVisa

TechnologyIndustries

Requirements

Bachelor's or master’s degree in computer science, Engineering, or a related field
Strong programming skills in languages such as Python, PySpark, SQL etc
Experience in building and optimizing ETL workflows using tools/technologies such as Spark, Snowflake, Airflow and/or Azure Data Factory, Glue, Redshift etc
Ability to craft and optimize complex SQL queries and stored procedures for data transformation, aggregation, and analysis
Experience in developing and maintaining data models ensuring scalability and optimal performance
Experience utilizing Snowpark for data processing within the Snowflake platform
Experience integrating Snowflake for efficient data storage and retrieval
Exposure to API integrations to facilitate data workflows
Experience in implementing CI-CD pipelines through DevOps platforms
Good experience in cloud infrastructure such as Azure, AWS or GCP
Good to have: Experience in Docker, Kubernetes etc
Exposure in HTML, CSS, Javascript/JQuery, Node.js, Angular/React
Experience in API development, Flask/Django is a bonus

Responsibilities

Collaborate with software engineers, business stakeholders and/or domain experts to translate business requirements into product features, tools, projects
Develop, implement, and deploy ETL solutions
Preprocess and analyze large datasets to identify patterns, trends, and insights
Evaluate, validate, and optimize data models to ensure efficiency, and generalizability
Monitor and maintain the performance of data pipeline, data models in production environments, identifying opportunities for improvement and update as needed
Document development processes, results, and lessons learned to facilitate knowledge sharing and continuous improvement

Skills

Python

PySpark

SQL

Spark

Snowflake

Airflow

Azure Data Factory

Glue

Redshift

Snowpark

ETL

CI-CD

Azure

AWS

GCP

Docker

Kubernetes

RPS North America

Global consulting firm for diverse sectors

About RPS North America

RPS North America provides consulting and advisory services across various sectors, including property, energy, transport, defense, government services, and water resources. The company helps clients, which range from large corporations to non-profits, navigate complex challenges and achieve regulatory compliance through a wide array of services. These services include management consulting, environmental consulting, project management, and digital solutions, among others. RPS North America stands out from its competitors by leveraging its deep expertise and global presence to deliver tailored solutions that meet specific client needs. The company's goal is to drive sustainable growth and address critical issues such as infrastructure development and risk management, ensuring a consistent demand for its high-value services.

Delft, NetherlandsHeadquarters

1970Year Founded

$31.5KTotal Funding

ACQUISITIONCompany Stage

Consulting, Energy, Enterprise SoftwareIndustries

5,001-10,000Employees