Lead Data Pipeline Engineer
Two Six TechnologiesSalary not specified
Full Time
Junior (1 to 2 years)
$140,000 – $200,000Compensation
Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
Construction, Artificial Intelligence, SoftwareIndustries
Requirements
Candidates should possess a BS/MS in Computer Science, Information Systems, or a related field and have over 5 years of experience in ETL development and data engineering. Strong coding proficiency in Python and database systems (SQL, noSQL) is required, along with substantial experience with pipeline orchestration tools like Prefect, infrastructure-as-code tools such as Terraform, and observability and monitoring tools. Familiarity with serverless architectures (e.g., AWS Lambda), ML workflows and requirements, data modeling, data warehouse concepts, and an interest in the construction industry are also necessary.
Responsibilities
The Pipeline Engineer will design, develop, and maintain robust file processing pipeline infrastructure, orchestrating data flow through various processing stages. Responsibilities include ensuring pipeline health through observability and monitoring, integrating data from diverse sources like industry storage platforms, project management tools, and external APIs, and implementing data quality checks and error handling mechanisms. Collaboration with the machine learning team to enhance pipeline functionality and efficiency is also a key duty.
Skills
Python
ETL
Data Engineering
Database Systems
Pipeline Development
Data Processing
Data Integration
API Integration
Data Quality
Error Handling
Observability
Monitoring
Trunk Tools
AI-driven incentive management software for construction
About Trunk Tools
Trunk Tools offers incentive management software tailored for the construction industry, featuring products like TrunkText and TrunkPerform. TrunkText uses artificial intelligence to help users quickly find project documents, while TrunkPerform enhances project performance by speeding up task completion. The company operates on a subscription-based model, providing software-as-a-service (SaaS) solutions that generate steady revenue. Trunk Tools aims to improve efficiency and productivity for construction professionals, distinguishing itself from competitors by focusing on their specific needs.
New York City, New YorkHeadquarters
2021Year Founded
$29.1MTotal Funding
SERIES_ACompany Stage
Enterprise Software, AI & Machine Learning, Financial ServicesIndustries
11-50Employees
Benefits
Health Insurance
Dental Insurance
Vision Insurance
Stock Options
Company Equity
401(k) Retirement Plan
Unlimited Paid Time Off
Flexible Work Hours
Professional Development Budget
Meal Benefits
Risks
Increased competition from AI-driven construction platforms could erode market share.
Slow adoption of new technologies in construction may hinder Trunk Tools' growth.
Economic uncertainty could reduce spending on new software solutions, impacting revenue.
Differentiation
Trunk Tools offers AI-driven solutions tailored for construction-specific workflows.
Their products, TrunkText and TrunkPerform, enhance efficiency and project performance.
The company focuses on fintech solutions for construction, unlike traditional banks.
Upsides
Raised $20M in Series A funding to accelerate growth and product development.
Growing demand for construction tech solutions, projected to reach $2.71 billion by 2025.
Integration of AI in construction management is gaining traction, benefiting Trunk Tools.
Related Jobs
RemoteRemoteSenior Software Engineer I, Backend
AledadeSalary not specified
- Full Time
- Senior (5 to 8 years)
RemoteSenior Python Engineer - ML and Data Science
ClickhouseSalary not specified
- Full Time
- Senior (5 to 8 years), Expert & Leadership (9+ years)
RemoteSr. Data Infrastructure Engineer
iSpot.tvSalary not specified
- Full Time
- Senior (5 to 8 years), Expert & Leadership (9+ years)
RemoteSenior Software Engineer, ML Data Services
Motional$155,300 - $207,000/year
- Full Time
- Senior (5 to 8 years)
RemoteData Engineer
Human InterestSalary not specified
- Full Time
- Mid-level (3 to 4 years), Senior (5 to 8 years)
RemoteTalent Pipeline
Trail of BitsSalary not specified
- Full Time
- Entry Level & New Grad
RemoteEngineer II, Data Services
TrueMLSalary not specified
- Full Time
- Mid-level (3 to 4 years), Senior (5 to 8 years)
RemoteSenior Software Engineer - Integrations
ChartHop$140,000 - $200,000/year
- Full Time
- Mid-level (3 to 4 years), Senior (5 to 8 years)
RemoteData Engineer - Software Engineer II
ChartbeatSalary not specified
- Full Time
- Junior (1 to 2 years)
RemoteSenior Software Engineer, Data Pipeline
Flock Safety$171,000 - $190,000/year
- Full Time
- Senior (5 to 8 years), Expert & Leadership (9+ years)
RemoteData Engineer / Senior Data Engineer
ArcadiaSalary not specified
- Full Time
- Senior (5 to 8 years)
RemoteDon't see what you're looking for? Join our Talent Network!…
Recorded FutureSalary not specified
- Full Time
- Junior (1 to 2 years)