Lead Data Pipeline Engineer
Two Six TechnologiesSalary not specified
Full Time
Junior (1 to 2 years)
Not SpecifiedCompensation
Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
Data & Analytics, Software, BiotechnologyIndustries
Requirements
Candidates must have 5+ years of experience as a data engineer and 8+ years of total software engineering experience, including data engineering roles. Expertise in SQL and Python is required, along with proficiency in at least one additional data engineering language such as Scala, Java, or Rust. Strong knowledge of data infrastructure and architecture design, as well as hands-on experience with modern orchestration tools like Airflow, Dagster, or Prefect, are essential. Experience developing and scaling dbt projects, working in a SaaS or high-growth tech environment, and experience with open table formats like Apache Iceberg are considered advantageous.
Responsibilities
The Senior Data Engineer will design, build, and manage scalable and reliable data pipelines for ingesting product and event data. They will develop and maintain canonical datasets for tracking key product and business metrics, and architect robust systems for large-volume batch data processing. This role involves driving decisions on data architecture, tooling, and engineering best practices, as well as enhancing the observability and monitoring of existing workflows. The engineer will also partner cross-functionally with various teams to understand data needs and deliver solutions, and provide product feedback by utilizing new data infrastructure and AI technology.
Skills
Data Engineering
Data Pipelines
Data Ecosystems
Analytics Engineering
Data Transformations
SQL
Python
Cloud Platforms (AWS, GCP, Azure)
ETL/ELT
Data Warehousing
Data Modeling
Software Engineering Best Practices
dbt
dbt Labs
Cloud-based data management platform for analytics
About dbt Labs
GetDBT.com is a cloud-based data management platform that helps companies streamline their data development processes. It allows users to write business logic more efficiently, enhances code reusability, and ensures data quality through testing and governance features. Unlike its competitors, GetDBT.com focuses on scalability and complexity, making it suitable for businesses at various stages of data maturity. The company's goal is to empower organizations to manage their data effectively while providing reliable service through a subscription model.
Philadelphia, PennsylvaniaHeadquarters
2016Year Founded
$403.1MTotal Funding
SERIES_DCompany Stage
Data & Analytics, Enterprise SoftwareIndustries
501-1,000Employees
Benefits
Unlimited Paid Time Off
401(k) Company Match
401(k) Retirement Plan
Health Insurance
Paid Parental Leave
Wellness Program
Home Office Stipend
Risks
Increased competition from Fivetran's integration may lead to customer attrition.
Dbt Mesh's complexity could cause integration challenges for existing users.
New executive appointments may lead to strategic shifts misaligned with customer expectations.
Differentiation
Dbt Labs offers a unique open-source analytics engineering tool for data transformation workflows.
The platform supports SQL-based data modeling, appealing to data analysts and engineers.
Dbt Mesh architecture allows cross-project model referencing, enhancing scalability for complex data needs.
Upsides
Collaboration with Fivetran enhances platform capabilities, attracting more enterprise clients.
Mark Porter's appointment as CTO could drive technological advancements and innovation.
Recent dbt Cloud enhancements improve collaboration, appealing to large teams and enterprises.
Related Jobs
RemoteRemotePrincipal Data Architect
Access SystemsSalary not specified
- Full Time
- Expert & Leadership (9+ years)
RemoteBig Data Engineer
ZoomSalary not specified
- Full Time
- Junior (1 to 2 years), Mid-level (3 to 4 years)
RemoteEngineering Manager, Data Platform
Arize AISalary not specified
- Full Time
- Senior (5 to 8 years)
RemoteSenior Software Engineer I, Backend
AledadeSalary not specified
- Full Time
- Senior (5 to 8 years)
RemoteData Architect
PartnerStackSalary not specified
- Full Time
- Senior (5 to 8 years)
RemoteSenior Software Engineer - Integrations
ChartHop$140,000 - $200,000/year
- Full Time
- Mid-level (3 to 4 years), Senior (5 to 8 years)
RemoteSenior Manager, Cloud Engineering
Modernizing MedicineSalary not specified
- Full Time
- Expert & Leadership (9+ years)
RemoteSenior Software Engineer - Data Engineering
Included HealthSalary not specified
- Full Time
- Senior (5 to 8 years)
RemoteStaff Data Scientist | Modeling
MachinifySalary not specified
- Full Time
- Expert & Leadership (9+ years)
RemoteSenior Cloud Data Infrastructure Engineer
Clickhouse$133,450 - $208,800/year
- Full Time
- Senior (5 to 8 years)
RemoteSenior Analytics Engineer
HealthieSalary not specified
- Full Time
- Senior (5 to 8 years), Expert & Leadership (9+ years)
RemoteSolutions Architect, Data Processing
NVIDIASalary not specified
- Full Time
- Junior (1 to 2 years)
RemoteStaff Data Engineer
PostscriptSalary not specified
- Full Time
- Expert & Leadership (9+ years)
RemoteSenior Software Engineer, Data Pipeline
Flock Safety$171,000 - $190,000/year
- Full Time
- Senior (5 to 8 years), Expert & Leadership (9+ years)