Staff Machine Learning Engineer, Applied Science at Hippocratic AI

Palo Alto, California, United States

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level

Full TimeJob Type

UnknownVisa

HealthcareIndustries

Requirements

Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field; PhD is a plus
7+ years of industry experience building and deploying ML systems, ideally with focus on LLMs or deep learning
Strong software engineering skills and experience developing in Python
Deep experience with ML frameworks like PyTorch or TensorFlow
Familiarity with distributed training frameworks (e.g., DeepSpeed, FSDP, Horovod)
Proven experience designing, implementing, and scaling ML pipelines for large models
Experience with cloud platforms (e.g., AWS, GCP, Azure) and container orchestration (e.g., Kubernetes, Docker)
Exposure to healthcare, clinical, or life sciences data is a strong plus

Responsibilities

Designing scalable, high-performance infrastructure for LLM training, fine-tuning, and inference
Building ML pipelines and tooling for experimentation, evaluation, and deployment
Optimizing model performance and efficiency in production environments
Collaborating cross-functionally to integrate ML solutions into end-user applications
Maintaining compliance with healthcare standards of safety, privacy, and reliability
Contributing to technical decision-making and defining the roadmap for scalable, safe ML systems

Skills

Key technologies and capabilities for this role

PythonPyTorchTensorFlowDeepSpeedFSDPHorovodKubernetesDockerAWSGCPAzure

Questions & Answers

Common questions about this position

What is the location requirement for this role?

The position is onsite in Palo Alto, CA, with hybrid arrangements considered. Preference is given to individuals who can work onsite at the HQ.

What is the salary for this Staff Machine Learning Engineer position?

This information is not specified in the job description.

What technical skills are required for this role?

Required skills include strong software engineering in Python, deep experience with ML frameworks like PyTorch or TensorFlow, familiarity with distributed training frameworks such as DeepSpeed, FSDP, or Horovod, and experience with cloud platforms and container orchestration like AWS, GCP, Azure, Kubernetes, and Docker.

What is the work environment like at Hippocratic AI?

It's a fast-paced, mission-driven environment focused on safety-focused generative AI for healthcare, with close collaboration between research scientists, product teams, and healthcare professionals.

What experience makes a strong candidate for this position?

Candidates need 7+ years of industry experience building and deploying ML systems, ideally with LLMs or deep learning, plus a Bachelor’s or Master’s in Computer Science or related field; PhD, healthcare exposure, and onsite availability in Palo Alto are strong pluses.