Tech Lead, Model Serving Efficiency at OpenAI

San Francisco, California, United States

Apply Now

$460,000 – $555,000Compensation

Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level

Full TimeJob Type

UnknownVisa

Artificial Intelligence, TechnologyIndustries

Requirements

Deep expertise in model performance optimization, particularly at the inference layer
Strong background in kernel-level systems, data movement, and low-level performance tuning
Enjoy mentoring and guiding junior engineers without formal management responsibilities
Excited about scaling high-performing AI systems that serve real-world, multimodal workloads
Ability to navigate ambiguity, set technical direction, and drive complex initiatives to completion

Responsibilities

Lead engineering efforts focused on improving model serving, inference performance, and system efficiency
Provide technical mentorship and oversight for a junior engineering team
Drive optimizations from a kernel and data movement perspective to improve system throughput and reliability
Partner closely with research and product teams to ensure our models perform effectively at scale
Design, build, and improve critical serving infrastructure to support Sora’s growth and reliability needs

Skills

Model Serving

Inference Optimization

Kernel Optimization

Data Movement

Performance Tuning

Systems Programming

Scalability Engineering

Serving Infrastructure

Mentoring

AI Systems

OpenAI

Develops safe and beneficial AI technologies

About OpenAI

OpenAI develops and deploys artificial intelligence technologies aimed at benefiting humanity. The company creates advanced AI models capable of performing various tasks, such as automating processes and enhancing creativity. OpenAI's products, like Sora, allow users to generate videos from text descriptions, showcasing the versatility of its AI applications. Unlike many competitors, OpenAI operates under a capped profit model, which limits the profits it can make and ensures that excess earnings are redistributed to maximize the social benefits of AI. This commitment to safety and ethical considerations is central to its mission of ensuring that artificial general intelligence (AGI) serves all of humanity.

San Francisco, CaliforniaHeadquarters

2015Year Founded

$18,433.2MTotal Funding

LATE_VCCompany Stage

AI & Machine LearningIndustries

1,001-5,000Employees