Principal Engineer – Platform Engineering at Hippocratic AI

Palo Alto, California, United States

Not SpecifiedCompensation

Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level

Full TimeJob Type

UnknownVisa

Healthcare, Artificial IntelligenceIndustries

12+ years in software engineering with strong experience in platform or distributed systems
Deep knowledge of AWS, GCP, or Azure, and multi-cloud architectures
Expertise in IaC tools (Terraform, Pulumi) and CI/CD automation
Experience with Kubernetes, GPU orchestration, or model-serving (e.g., Ray, Triton, SGLang)
Proficiency with observability tools (Prometheus, Grafana, OpenTelemetry, Datadog)
Strong understanding of cloud security, networking, and cost optimization
Excellent communicator and mentor; strong cross-team collaboration skills

Architect and scale the multi-cloud platform for AI inference and SaaS workloads
Lead design for performance, reliability, and cost optimization
Build automation and tooling using infrastructure-as-code and CI/CD best practices
Partner with research to productionize models efficiently
Improve observability, telemetry, and incident response
Foster a culture of technical and operational excellence
Hire and mentor strong engineers to guide long-term technical strategy
Evaluate emerging technologies in AI infra, GPU orchestration, and distributed systems
Define the technical direction for our platform
Architect systems for large-scale model training and inference