Delivery Director at Turing

Palo Alto, California, United States

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level

Full TimeJob Type

UnknownVisa

Artificial Intelligence, TechnologyIndustries

Requirements

10+ years of experience building and leading large scale technical delivery teams
Proven ability to lead large cross functional teams (100+) by building strong operations
Bachelor’s degree in Engineering, Computer Science or equivalent practical experience leading large-scale technical initiatives
Demonstrated experience managing large-scale dataset generation or annotation for LLMs, ideally with experience in RLHF or SFT pipelines
Strong understanding of quality review mechanisms including prompt win rate, agreement metrics, inter-annotator consistency, and preference modeling
Experience with human data generation across at least one of the modalities (Text, Image, Video, Audio)
Technical fluency in Python, cloud infrastructure, data platforms, machine learning concepts and modern Machine Learning tooling (e.g., HuggingFace, LangChain, Weights & Biases)
Strong communication skills with experience presenting to executive stakeholders, managing client escalations, and aligning delivery with strategic goals
Preferred Qualifications
Prior experience at AI Data Platform companies
Past experience with retrieval augmented generation (RAG), fine-tuning, and human evaluation workflows
Familiarity with fine-tuning LLMs, prompt engineering at scale, and instruction dataset design
Familiarity with benchmarks (SWE Bench, MMMLU, or equivalent)

Responsibilities

Lead the generation and delivery of high-quality, scalable LLM training datasets with a focus on SFT, RLHF, Reasoning, and agentic workflows
Oversee the end-to-end data lifecycle from client intake to delivery, including collaboration with the clients for defining the data requirements, writing down the data annotation steps/workflow, quality metrics, review workflows, and delivery setup
Serve as the primary client contact for large enterprise engagements; manage stakeholder expectations, requirements gathering, and delivery timelines
Collaborate with engineering, product, research, and delivery teams to ensure technical feasibility and alignment across workstreams
Develop, document, and refine best practices for prompt evaluation, data schema design, evaluation metrics (e.g., win rate, pairwise preference), and human-in-the-loop QA
Recruit, manage, and mentor engineering leads and program managers working across multiple AI training pods
Operate as a strategic business partner to our clients; provide insight on tradeoffs, resourcing, and performance metrics
Build internal capability by harvesting reusable assets and contribute in continued improvements across data quality, tools and processes

Skills

Key technologies and capabilities for this role

LLM trainingSFTRLHFdata annotationdata pipelinesannotation workflowsquality metricsreasoning workflowsagentic workflowsstakeholder managementclient requirements gathering

Questions & Answers

Common questions about this position

What experience level is required for the Delivery Director role?

The role requires 10+ years of experience building and leading large scale technical delivery teams, proven ability to lead large cross-functional teams (100+), and demonstrated experience managing large-scale dataset generation or annotation for LLMs.

What education is required for this position?

A Bachelor’s degree in Engineering, Computer Science or equivalent practical experience leading large-scale technical initiatives is required.

Is this role remote or office-based?

This information is not specified in the job description.

What is the salary or compensation for the Delivery Director position?

This information is not specified in the job description.

What makes a strong candidate for this Delivery Director role?

A strong candidate combines deep technical understanding of the LLM training lifecycle, experience leading large cross-functional teams of 100+, and expertise in managing dataset generation/annotation for LLMs, along with client-facing leadership skills.

Turing

AI-driven matching of businesses with engineers

About Turing

Turing provides tech services by using artificial intelligence to connect businesses with skilled software engineers for custom application development and on-demand engineering needs. The company has a large pool of over 3 million vetted engineers from 150 countries, allowing businesses to quickly find the right talent for their projects. When a company needs a developer, they specify the required skills, and Turing's AI matches them with the best candidates, streamlining the recruitment process and helping companies complete projects faster. Turing also supports engineers by offering access to high-paying remote job opportunities in the U.S., with a high rematch rate ensuring job stability. The goal of Turing is to enhance recruitment efficiency for businesses while providing valuable job opportunities for engineers.

Palo Alto, CaliforniaHeadquarters

2018Year Founded

$132.3MTotal Funding

SERIES_DCompany Stage

Enterprise Software, AI & Machine LearningIndustries

1,001-5,000Employees