Senior Cloud Data Infrastructure Engineer
ClickhouseFull Time
Senior (5 to 8 years), Expert & Leadership (9+ years)
Hyderabad, Telangana, India
Candidates should have 3+ years of hands-on Kubernetes experience, 5+ years of industry experience, and experience with Python/Shell Scripting. A strong understanding of microservices/service-oriented architecture, strong knowledge and hands-on experience in Linux/Unix Operating Systems, and strong knowledge and hands-on experience in setting up and debugging networking issues are required. Experience with Infrastructure as Code tools like Helm and terraform, along with working experience and advanced understanding of at least two cloud platforms (AWS, Azure, or Google Cloud), is essential. Candidates must also possess a significant level of comfort interacting with customers via various mediums, strong oral and written communication skills, empathy, and a desire to help customers succeed.
The Senior Solutions Engineer will work with strategic private-cloud customers to adopt and benefit from Astronomer's offerings for deploying and managing Apache Airflow clusters and related infrastructure. Responsibilities include assisting customers with installations and support of their technology stack for private-cloud installations, managing assigned accounts to ensure customers extract maximum value from their Astronomer investment, and supporting Astronomer Managed Airflow Software installations on on-premise environments. The role involves identifying, setting up, and measuring monitoring & alerting metrics for customer on-prem Astronomer Software infrastructure, independently troubleshooting infrastructure issues related to Kubernetes-based private-cloud offerings, and driving major incidents, root cause analysis, and change impact analysis. Additionally, the engineer will identify and develop automation using scripts for environment monitoring and health checks, provide guidance to the team for critical/complex infrastructure issues, maintain and improve technical expertise on Airflow and Astronomer products, and act as a liaison by collecting feedback and relaying recommendations to the Product team.
Data orchestration platform for pipeline management
Astronomer.io provides a data orchestration platform that utilizes Apache Airflow to simplify the deployment of data pipelines. Its main product, Astro, helps businesses manage and monitor their data flows, allowing them to focus on delivering essential data pipelines. The platform supports data unification across various clouds and offers over 1500 integrations, making it suitable for data and machine learning teams in industries like finance and e-commerce. Astronomer.io distinguishes itself from competitors by offering enterprise-grade security, zero-downtime upgrades for Airflow, and tools for monitoring pipeline health, which enhance compute efficiency and reduce delays in task scheduling. The company's goal is to empower organizations to optimize their data strategies and achieve a significant return on investment by ensuring their applications operate with maximum reliability.