Senior Principal Data Platform Engineer

New York, New York, United States

Apply with AI Apply

Not SpecifiedCompensation

Expert & Leadership (9+ years)Experience Level

Full TimeJob Type

UnknownVisa

Enterprise Software, Data Management, AI, Privacy, Security, Risk ManagementIndustries

Requirements

Candidates must possess a Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field, along with a minimum of 10 years of overall experience and at least 6 years specifically focused on large-scale data warehouse projects. Strong SQL skills and knowledge of dimensional modeling are required, as well as 7+ years of experience with Python for data extraction and transformation. Furthermore, 5+ years of experience with Snowflake, Airflow, and ETL/Integration tools administration is necessary. Hands-on experience with Data Warehouse technologies like Snowflake and Redshift, and Big Data technologies such as Hadoop, Hive, Spark, Kafka, and Kinesis is also expected.

Responsibilities

The Senior Principal Data Platform Engineer will build and automate modern data platforms using technologies like AWS, Azure, and Snowflake, deploying applications and provisioning infrastructure. They will perform administration, maintenance, and provide support to production systems including Snowflake, Fivetran, DBT, Power BI, and Airflow. The role involves building and maintaining CI/CD pipelines and utilizing infrastructure as code (IaC) practices. Additionally, the engineer will design, build, and implement automation frameworks to deliver data with measurable quality under service level agreements (SLAs), drive technical conversations with stakeholders to understand platform needs, and work collaboratively with scrum teams to deliver value. Finally, they will reduce technical debt through root cause analysis, issue resolution, and the promotion of best practices across the platform.

Skills

Data Platform Engineering

AWS

Azure

Snowflake

Fivetran

DBT

Power BI

Airflow

CI/CD

Infrastructure as Code (IaC)

Automation Frameworks

Data Governance

Risk Management

Data Architecture

Data Quality

SLA Management

OneTrust

Data privacy and governance management platform

About OneTrust

OneTrust provides a platform that assists businesses in managing their data privacy, governance, risk, and compliance needs. The platform helps organizations visualize and control their data, addressing the challenge of 'data sprawl' by tracking what data they have, where it is stored, and how it is used. This is crucial for ensuring compliance with various laws and regulations regarding data usage and customer privacy. OneTrust serves a wide range of businesses, from small companies to large enterprises, all of which need to handle data responsibly. The company operates on a subscription model, where clients pay a recurring fee based on their size and data management needs. OneTrust's goal is to empower businesses to use data ethically while maintaining compliance with legal standards.

Atlanta, GeorgiaHeadquarters

2016Year Founded

$1,089.5MTotal Funding

LATE_VCCompany Stage

Data & Analytics, Enterprise Software, CybersecurityIndustries

1,001-5,000Employees