Staff Software Engineer, Infrastructure at Astronomer

New York, New York, United States

Astronomer Logo
Not SpecifiedCompensation
Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level
Full TimeJob Type
UnknownVisa
Technology, Data OrchestrationIndustries

Requirements

  • 8+ years of backend or infrastructure engineering experience, with at least 2 years in a technical leadership role
  • Strong communication and collaboration skills to work with cross-functional teams across time zones
  • Experience driving technical strategy and conversations with customers, gathering feedback, and influencing product direction
  • Extensive experience with cloud providers like AWS, Azure, or GCP
  • Strong experience with Kubernetes, including hands-on experience testing systems running on K8s
  • Proficient in Golang and/or Python, and comfortable working with distributed systems, container orchestration, and CI/CD
  • Successfully led the design and execution of complex technical initiatives
  • Care deeply about team dynamics, process quality, and helping engineers grow
  • Thrive in a fast-paced, asynchronous, remote-first environment
  • Deep understanding of CI/CD tools such as GitHub Actions, CircleCI, and Jenkins
  • Familiarity with logging and observability tools: Prometheus, Grafana, Fluent Bit, ELK stack
  • Solid understanding of GitOps, Docker, and Helm charts

Responsibilities

  • Own code quality, design decisions, and technical artifacts across the team’s work
  • Drive architectural direction and enforce engineering best practices
  • Collaborate with PM and EM on scoping, planning, and maintaining a prioritized roadmap
  • Drive technical conversations and strategy with customers, translating requirements into scalable solutions and influencing roadmap direction
  • Provide technical mentorship and delegate effectively to support team growth
  • Define and evolve team processes, including code review, testing, on-call, and dev experience
  • Lead retrospectives and drive continuous improvement initiatives
  • Contribute hands-on to core platform components using Nodejs, Golang, Python, Kubernetes, and Terraform

Skills

Kubernetes
Distributed Systems
Cloud Native
System Design
Apache Airflow
Engineering Best Practices

Astronomer

Data orchestration platform for pipeline management

About Astronomer

Astronomer.io provides a data orchestration platform that utilizes Apache Airflow to simplify the deployment of data pipelines. Its main product, Astro, helps businesses manage and monitor their data flows, allowing them to focus on delivering essential data pipelines. The platform supports data unification across various clouds and offers over 1500 integrations, making it suitable for data and machine learning teams in industries like finance and e-commerce. Astronomer.io distinguishes itself from competitors by offering enterprise-grade security, zero-downtime upgrades for Airflow, and tools for monitoring pipeline health, which enhance compute efficiency and reduce delays in task scheduling. The company's goal is to empower organizations to optimize their data strategies and achieve a significant return on investment by ensuring their applications operate with maximum reliability.

Cincinnati, OhioHeadquarters
2018Year Founded
$272.1MTotal Funding
SERIES_CCompany Stage
Data & Analytics, Enterprise Software, CybersecurityIndustries
201-500Employees

Benefits

Remote Work Options
Company Equity

Risks

Increased competition from platforms like Prefect and Dagster poses a market challenge.
Over-reliance on Apache Airflow could be risky if community focus shifts.
Rapid AI advancements may outpace Astronomer's feature integration, risking client dissatisfaction.

Differentiation

Astronomer offers Astro, a modern data orchestration platform powered by Apache Airflow.
Astro enables data teams to build, run, and observe data pipelines-as-code efficiently.
Astronomer provides enterprise-grade security and over 1500 integrations for data unification.

Upsides

Astronomer's revenue grew over 200% in H1 2023, indicating strong market demand.
Collaboration with Microsoft Azure enhances Astronomer's cloud-native data orchestration capabilities.
Integration with Anyscale boosts Astronomer's offering for scalable machine learning workflows.

Land your dream remote job 3x faster with AI