Tech Lead, Model Serving Efficiency at OpenAI

San Francisco, California, United States

Apply Now

$460,000 – $555,000Compensation

Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level

Full TimeJob Type

UnknownVisa

Artificial Intelligence, TechnologyIndustries

Requirements

Deep expertise in model performance optimization, particularly at the inference layer
Strong background in kernel-level systems, data movement, and low-level performance tuning
Enjoy mentoring and guiding junior engineers without formal management responsibilities
Excited about scaling high-performing AI systems that serve real-world, multimodal workloads
Ability to navigate ambiguity, set technical direction, and drive complex initiatives to completion

Responsibilities

Lead engineering efforts focused on improving model serving, inference performance, and system efficiency
Provide technical mentorship and oversight for a junior engineering team
Drive optimizations from a kernel and data movement perspective to improve system throughput and reliability
Partner closely with research and product teams to ensure our models perform effectively at scale
Design, build, and improve critical serving infrastructure to support Sora’s growth and reliability needs

Skills

Key technologies and capabilities for this role

Model ServingInference OptimizationKernel OptimizationData MovementPerformance TuningSystems ProgrammingScalability EngineeringServing InfrastructureMentoringAI Systems

Questions & Answers

Common questions about this position

What is the salary range for the Tech Lead, Model Serving Efficiency role?

The salary range is $460K - $555K.

Is this position remote or hybrid, and what's the office requirement?

This is a hybrid role requiring 3 days in office per week in San Francisco, CA.

What key skills are required for this Tech Lead position?

Candidates need deep expertise in model performance optimization at the inference layer, strong background in kernel-level systems, data movement, and low-level performance tuning, plus the ability to navigate ambiguity and set technical direction.

What is the work environment like at OpenAI for this role?

You'll work closely with leadership, a growing team of junior engineers, research, and product teams in a mission-driven environment focused on benefiting humanity through AI, with a hybrid setup in San Francisco.

What makes a strong candidate for this Tech Lead role?

Strong candidates enjoy mentoring junior engineers, have expertise in optimizing AI model inference and low-level systems, and can drive complex initiatives in ambiguous environments while excited about scaling multimodal AI systems.

OpenAI

Develops safe and beneficial AI technologies

About OpenAI

OpenAI develops and deploys artificial intelligence technologies aimed at benefiting humanity. The company creates advanced AI models capable of performing various tasks, such as automating processes and enhancing creativity. OpenAI's products, like Sora, allow users to generate videos from text descriptions, showcasing the versatility of its AI applications. Unlike many competitors, OpenAI operates under a capped profit model, which limits the profits it can make and ensures that excess earnings are redistributed to maximize the social benefits of AI. This commitment to safety and ethical considerations is central to its mission of ensuring that artificial general intelligence (AGI) serves all of humanity.

San Francisco, CaliforniaHeadquarters

2015Year Founded

$18,433.2MTotal Funding

LATE_VCCompany Stage

AI & Machine LearningIndustries

1,001-5,000Employees