Principal Observability Architect

The Principal Observability Architect will lead the architecture and roadmap for a multi-region, multi-cloud, multi-tenant observability platform, designing near real-time telemetry ingestion pipelines with low-latency guarantees. They will define observability blueprints including telemetry SLAs, data contracts, tenant data isolation, and cost-aware retention strategies. Responsibilities include ensuring observability systems are cloud-native and container-aware, designing and implementing real-time metrics, logs, traces, and event pipelines, and embedding real-time anomaly detection and signal correlation with context-aware alerting. The role involves integrating with alerting and incident response tools, ensuring observability of synthetic probes, end-user transactions, and critical SLOs, standardizing OpenTelemetry instrumentation, architecting OpenTelemetry deployment patterns, and embedding observability validation gates into CI/CD workflows. Additionally, they will provide self-service tools and training to enable developer teams, leverage AI/ML for anomaly detection, predictive incident detection, and correlation, and build or integrate LLM-powered tools for natural language querying, AI-assisted debugging, and generative runbooks.