Data Engineer
Human InterestFull Time
Mid-level (3 to 4 years), Senior (5 to 8 years)
Candidates should have 3+ years of production experience with Python and SQL, strong experience with dbt for data modeling and transformation, and experience with Apache Airflow for workflow orchestration. Proficiency with cloud data warehouses, experience with infrastructure as code, and a strong understanding of data warehouse design patterns and best practices are also required, along with experience with Git, CI/CD pipelines, and collaborative development workflows. Experience with Pulumi, PostHog, HubSpot, real-time data processing, and a background in developer tools or B2B SaaS companies are considered bonus points.
The Data Engineer will be responsible for designing, building, and maintaining scalable ETL/ELT pipelines using Airflow and Meltano, developing and optimizing dbt models, and implementing data quality monitoring, testing, and alerting. They will manage data ingestion from multiple sources, manage BigQuery datasets and slot allocation, deploy and maintain Airflow DAGs, and implement infrastructure as code using Pulumi. Responsibilities also include monitoring pipeline performance, optimizing for cost and efficiency, building and maintaining a multi-layered data warehouse architecture, designing and implementing data governance policies, optimizing BigQuery performance, developing and maintaining reverse ETL pipelines, building attribution models, creating automated triggers for sales and marketing outreach, and implementing data quality checks for reverse ETL processes. The role involves working closely with other teams, maintaining documentation, participating in code reviews, and supporting team members in using datasets and analytical tools.
Open-source backend service for developers
Supabase provides an open-source backend as a service (BaaS) platform that helps developers and businesses create scalable applications more easily. It offers real-time databases, authentication, and storage solutions, all designed to integrate smoothly into existing workflows. This means developers can focus on building their applications without needing to spend a lot of time on backend development. Supabase operates on a freemium model, where users can access basic services for free, while advanced features are available through paid subscriptions. This approach allows it to cater to various user needs. What sets Supabase apart from its competitors is its open-source nature, which allows users to customize the platform and benefit from community-driven enhancements. The company aims to provide a reliable and efficient solution for developers, ensuring high uptime for applications that are critical to their users.