[Remote] Director of Engineering, Observability at Astronomer

San Francisco, California, United States

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

Data Management, Software, DataOpsIndustries

Requirements

Proven experience leading engineering teams and managers in a fast-paced, high-growth environment
Strong technical background, ideally with experience in Golang, Python, Kubernetes, SQL/OLAP databases, and stream processing
Excellent communication and collaboration skills, with the ability to influence at all levels of the organization
Strong focus on customer value, bringing clarity and alignment between technical priorities and business outcomes
Experience building or scaling data observability products
Familiarity with Apache Airflow or similar workflow orchestrators
Bonus Points: Experience building or scaling data observability products, familiarity with Apache Airflow or similar workflow orchestrators

Responsibilities

Define and drive the technical strategy, roadmap, and execution for Astronomer’s observability platform
Lead, grow, and mentor a team of engineers with a focus on collaboration, innovation, and customer impact
Partner with product, design, and other engineering leaders to shape the future of observability and governance within Astronomer’s platform
Ensure the architecture, design, and implementation of the observability platform are scalable, reliable, and performant
Foster a culture of engineering excellence, including strong practices around code quality, testing, CI/CD, and operational rigor
Represent the Observability team internally and externally, helping align stakeholders around shared goals
Collaborate with cross-functional teams to identify and prioritize technical requirements and deliverables

Skills

Data Observability

Apache Airflow

Software Architecture

Team Leadership

Technical Strategy

Data Pipelines

Data Products

Astronomer

Data orchestration platform for pipeline management

About Astronomer

Astronomer.io provides a data orchestration platform that utilizes Apache Airflow to simplify the deployment of data pipelines. Its main product, Astro, helps businesses manage and monitor their data flows, allowing them to focus on delivering essential data pipelines. The platform supports data unification across various clouds and offers over 1500 integrations, making it suitable for data and machine learning teams in industries like finance and e-commerce. Astronomer.io distinguishes itself from competitors by offering enterprise-grade security, zero-downtime upgrades for Airflow, and tools for monitoring pipeline health, which enhance compute efficiency and reduce delays in task scheduling. The company's goal is to empower organizations to optimize their data strategies and achieve a significant return on investment by ensuring their applications operate with maximum reliability.

Cincinnati, OhioHeadquarters

2018Year Founded

$272.1MTotal Funding

SERIES_CCompany Stage

Data & Analytics, Enterprise Software, CybersecurityIndustries

201-500Employees

Benefits

Remote Work Options

Company Equity

Risks

Increased competition from platforms like Prefect and Dagster poses a market challenge.

Over-reliance on Apache Airflow could be risky if community focus shifts.

Rapid AI advancements may outpace Astronomer's feature integration, risking client dissatisfaction.

Differentiation

Astronomer offers Astro, a modern data orchestration platform powered by Apache Airflow.

Astro enables data teams to build, run, and observe data pipelines-as-code efficiently.

Astronomer provides enterprise-grade security and over 1500 integrations for data unification.

Upsides

Astronomer's revenue grew over 200% in H1 2023, indicating strong market demand.

Collaboration with Microsoft Azure enhances Astronomer's cloud-native data orchestration capabilities.

Integration with Anyscale boosts Astronomer's offering for scalable machine learning workflows.

Land your dream remote job 3x faster with AI

Try Jobo Free