Astronomer

Senior Engineering Manager

New York, New York, United States

Not SpecifiedCompensation
Expert & Leadership (9+ years)Experience Level
Full TimeJob Type
UnknownVisa
Data Management, Software Development, Cloud ComputingIndustries

About Astronomer

Astronomer empowers data teams to bring mission-critical software, analytics, and AI to life and is the company behind Astro, the industry-leading unified DataOps platform powered by Apache Airflow®. Astro accelerates building reliable data products that unlock insights, unleash AI value, and powers data-driven applications. Trusted by more than 700 of the world's leading enterprises, Astronomer lets businesses do more with their data.

Your background may be unconventional; as long as you have the essential qualifications, we encourage you to apply. While having "bonus" qualifications makes for a strong candidate, Astronomer values diverse experiences. Many of us at Astronomer haven't followed traditional career paths, and we welcome it if yours hasn't either.

About this role

As a Senior Engineering Manager at Astronomer, you will play a pivotal role in leading and guiding a team of talented engineers bringing commercial value to Apache Airflow OSS. Your primary goal will be to foster a high-performing and innovative engineering culture, ensuring that our products meet the highest standards of quality and efficiency.

In this role, you will collaborate extensively with leadership across various departments, including Engineering, Product Management, Customer Support and Field engineering. It's a great opportunity to work on some of the most challenging problems in data orchestration while contributing to the development of Astronomer’s next-generation product suite.

What you get to do

  • Lead our globally distributed Airflow Infrastructure team to deliver an exceptional Apache Airflow experience, bridging the gap between open-source software and our commercial initiatives to set new industry standards in data orchestration.
  • Provide technical mentorship to a team of skilled software engineers, offering guidance and support to foster their growth, enhance their skills, and drive their professional development.
  • Oversee the entire lifecycle of engineering projects, from initial concept and design to development, testing, deployment, and ongoing support.
  • Collaborate closely with the Engineering Tech Lead, Product Managers, Engineering Leadership, and other key stakeholders to ensure engineering projects are aligned with company objectives and customer needs.
  • Ensure projects are on track, resources are allocated efficiently, and deadlines are met.
  • Collaborate closely with our support and customer facing teams to gather insights on customer issues and feedback, and integrate them back into the product.
  • Drive efforts to identify and address performance bottlenecks, ensuring the Airflow infrastructure system can handle high-throughput workloads while maintaining low latency and resource efficiency.
  • Work with the team to implement comprehensive logging, monitoring, and alerting strategies, ensuring end-to-end visibility into system health and performance, enabling rapid identification and resolution of issues.
  • Take a proactive approach in identifying and managing technical debt, including driving towards a sustainable long term technical architecture.

What you bring to the role

  • Deep prior experience in software engineering, with multiple years of experience in a people management role.
  • Strong technical background in distributed systems, data engineering, cloud computing, and technologies like Kubernetes and Docker.
  • Ability to identify and solve complex technical challenges, balancing immediate needs with long-term solutions that ensure system stability, scalability, and performance.
  • Proven track record in setting clear expectations and goals for the engineering team, delivering high-quality software products reliably and on time.
  • Demonstrated ability to develop detailed project execution plans, including the proactive identification and effective communication of potential risks.
  • Ability to work cross-functionally with product managers, stakeholders, and external customers.

Employment Type

FullTime

Location Type

Remote

Skills

Apache Airflow
Data Orchestration
Infrastructure
Team Leadership
Mentorship
Software Development
Product Development
Customer Support
Field Engineering

Astronomer

Data orchestration platform for pipeline management

About Astronomer

Astronomer.io provides a data orchestration platform that utilizes Apache Airflow to simplify the deployment of data pipelines. Its main product, Astro, helps businesses manage and monitor their data flows, allowing them to focus on delivering essential data pipelines. The platform supports data unification across various clouds and offers over 1500 integrations, making it suitable for data and machine learning teams in industries like finance and e-commerce. Astronomer.io distinguishes itself from competitors by offering enterprise-grade security, zero-downtime upgrades for Airflow, and tools for monitoring pipeline health, which enhance compute efficiency and reduce delays in task scheduling. The company's goal is to empower organizations to optimize their data strategies and achieve a significant return on investment by ensuring their applications operate with maximum reliability.

Cincinnati, OhioHeadquarters
2018Year Founded
$272.1MTotal Funding
SERIES_CCompany Stage
Data & Analytics, Enterprise Software, CybersecurityIndustries
201-500Employees

Benefits

Remote Work Options
Company Equity

Risks

Increased competition from platforms like Prefect and Dagster poses a market challenge.
Over-reliance on Apache Airflow could be risky if community focus shifts.
Rapid AI advancements may outpace Astronomer's feature integration, risking client dissatisfaction.

Differentiation

Astronomer offers Astro, a modern data orchestration platform powered by Apache Airflow.
Astro enables data teams to build, run, and observe data pipelines-as-code efficiently.
Astronomer provides enterprise-grade security and over 1500 integrations for data unification.

Upsides

Astronomer's revenue grew over 200% in H1 2023, indicating strong market demand.
Collaboration with Microsoft Azure enhances Astronomer's cloud-native data orchestration capabilities.
Integration with Anyscale boosts Astronomer's offering for scalable machine learning workflows.

Land your dream remote job 3x faster with AI