Head of Data Operations at Hippocratic AI

Palo Alto, California, United States

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level

Full TimeJob Type

UnknownVisa

Healthcare, Artificial IntelligenceIndustries

Requirements

10+ years of experience in data operations, annotation, or model evaluation
5+ years in management or leadership roles
Proven success scaling data or RLHF operations across

Responsibilities

Build, lead, and scale a global data operations organization including full-time employees, contractors, and vendor partners
Define clear roles, quality standards, and performance metrics across all data functions (evaluation, labeling, RLHF, and generation)
Partner with Legal, Compliance, and Security to ensure all global data work adheres to HIPAA and data privacy standards
Oversee the design and execution of evaluation frameworks for LLMs and agentic behaviors — both automated and human-in-the-loop
Lead data labeling, synthesis, and annotation operations, ensuring medical accuracy, consistency, and context-rich quality
Manage large-scale RLHF pipelines — aligning training data with clinical and ethical objectives
Optimize throughput, cost, and quality across in-house teams and external vendors
Partner with engineering and product to design and improve data operations infrastructure, including labeling tools, quality assurance systems, and task routing platforms
Implement robust QA processes and auditing frameworks to ensure data integrity and reliability
Drive continuous improvement in efficiency, consistency, and evaluator experience
Work closely with Research, Model, and Product teams to define data needs and feedback loops
Collaborate with Clinical and Safety leaders to align annotation and evaluation standards with clinical guidelines
Provide strategic input into data strategy, metrics, and operational planning

Skills

Key technologies and capabilities for this role

Data OperationsData AnnotationData LabelingModel EvaluationRLHFReinforcement LearningHealthcare AILLMData SourcingScalability

Questions & Answers

Common questions about this position

Is this role remote or onsite?

This is an onsite role requiring the team to be in the office five days a week in Palo Alto, CA.

What is the salary or compensation for this position?

This information is not specified in the job description.

What key skills and experience are required for the Head of Data Operations role?

The role requires leadership in building and scaling global data operations teams, expertise in data labeling, annotation, evaluation frameworks for LLMs, and managing RLHF pipelines, with knowledge of HIPAA and data privacy standards.

What is the company culture like at Hippocratic AI?

The company values in-person teamwork, believing the best ideas happen together, and features a world-class team of healthcare and AI experts working on a safety-focused LLM for global health impact.

What makes a strong candidate for this Head of Data Operations position?

Strong candidates will have experience leading global teams and vendors in data operations, including data generation, annotation, evaluation, and RLHF, with a focus on scalability, medical accuracy, and adherence to safety, ethics, and HIPAA standards.