Airflow Reliability Engineer at Astronomer

Hyderabad, Telangana, India

Apply Now

Not SpecifiedCompensation

Mid-level (3 to 4 years)Experience Level

Full TimeJob Type

UnknownVisa

TechnologyIndustries

Requirements

4 years of professional experience (any industry)
2 years of experience with Python
Knowledge of Kubernetes/Docker/Containers
Customer Support experience
Experience working with a distributed system with any major cloud provider (AWS, GCP, Azure)
Problem-solving and troubleshooting abilities
Work well with autonomy and independence
Strong written and verbal communication for connecting with customers over ticketing system and Zoom
Based in Hyderabad and able to work in shifts (typically early morning or evening IST)
Willingness to participate in 6-hour pager period during workday and paid on-call rotation for weekend coverage

Responsibilities

Learn and build expertise across Airflow, data engineering, Kubernetes, and Cloud Engineering
Solve challenging Airflow problems for customers, from optimizing configuration to identifying bugs
Spend up to 20% of time on side projects contributing to Astronomer’s success (e.g., open-source Airflow contributions, internal monitoring/alerting systems)
Work directly with customers’ data engineers, system admins, DevOps teams, and management
Provide feedback from experience to shape the direction of the Airflow project
Own the customer experience: prioritize and solve issues, meet SLAs, provide “white glove” guidance
Participate remotely within a fully distributed team
Help maintain 24x7 coverage through specified pager periods and on-call rotation

Skills

Key technologies and capabilities for this role

Apache AirflowKubernetesData EngineeringCloud EngineeringSoftware Engineering

Questions & Answers

Common questions about this position

Is this role remote or does it require office presence?

This role is based in Hyderabad and requires working in shifts, typically early morning or evening IST; the exact schedule will be set during hiring.

What skills will I develop or need in this Airflow Reliability Engineer role?

You will learn and build expertise in Airflow and data engineering, Kubernetes, and Cloud Engineering, while solving challenging Airflow problems for customers.

What is the salary or compensation for this position?

This information is not specified in the job description.

What is the team culture like for the CRE team at Astronomer?

The CRE team is Astronomer’s support team that provides high levels of expertise with strong technical knowledge and customer empathy, where every day brings new challenges and learning opportunities.

What makes a strong candidate for this Airflow Reliability Engineer position?

Strong candidates are self-motivated learners who aim to become experts in new technologies, demonstrate customer empathy, and are eager to tackle challenging problems, such as those who finish MIT OpenCourseWare courses.

Astronomer

Data orchestration platform for pipeline management

About Astronomer

Astronomer.io provides a data orchestration platform that utilizes Apache Airflow to simplify the deployment of data pipelines. Its main product, Astro, helps businesses manage and monitor their data flows, allowing them to focus on delivering essential data pipelines. The platform supports data unification across various clouds and offers over 1500 integrations, making it suitable for data and machine learning teams in industries like finance and e-commerce. Astronomer.io distinguishes itself from competitors by offering enterprise-grade security, zero-downtime upgrades for Airflow, and tools for monitoring pipeline health, which enhance compute efficiency and reduce delays in task scheduling. The company's goal is to empower organizations to optimize their data strategies and achieve a significant return on investment by ensuring their applications operate with maximum reliability.

Cincinnati, OhioHeadquarters

2018Year Founded

$272.1MTotal Funding

SERIES_CCompany Stage

Data & Analytics, Enterprise Software, CybersecurityIndustries

201-500Employees

Benefits

Remote Work Options

Company Equity

Risks

Increased competition from platforms like Prefect and Dagster poses a market challenge.

Over-reliance on Apache Airflow could be risky if community focus shifts.

Rapid AI advancements may outpace Astronomer's feature integration, risking client dissatisfaction.

Differentiation

Astronomer offers Astro, a modern data orchestration platform powered by Apache Airflow.

Astro enables data teams to build, run, and observe data pipelines-as-code efficiently.

Astronomer provides enterprise-grade security and over 1500 integrations for data unification.

Upsides

Astronomer's revenue grew over 200% in H1 2023, indicating strong market demand.

Collaboration with Microsoft Azure enhances Astronomer's cloud-native data orchestration capabilities.

Integration with Anyscale boosts Astronomer's offering for scalable machine learning workflows.

Land your dream remote job 3x faster with AI

Try Jobo Free