Software Engineer, Inference - Multi Modal at OpenAI

San Francisco, California, United States

Apply Now

$325,000 – $490,000Compensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

Artificial Intelligence, TechnologyIndustries

Requirements

Have experience building and scaling inference systems for LLMs or multimodal models
Have worked with GPU-based ML workloads and understand the performance dynamics of large models, especially with complex data like images or audio
Enjoy experimental, fast-evolving work and collaborating closely with research
Are comfortable dealing with systems that span networking, distributed compute, and high-throughput data handling
Have familiarity with inference tooling like vLLM, TensorRT-LLM, or custom model parallel systems
Own problems end-to-end and are excited to operate in ambiguous, fast-moving spaces

Responsibilities

Design and implement inference infrastructure for large-scale multimodal models
Optimize systems for high-throughput, low-latency delivery of image and audio inputs and outputs
Enable experimental research workflows to transition into reliable production services
Collaborate closely with researchers, infra teams, and product engineers to deploy state-of-the-art capabilities
Contribute to system-level improvements including GPU utilization, tensor parallelism, and hardware abstraction layers

Skills

Key technologies and capabilities for this role

Inference InfrastructureMultimodal ModelsGPU UtilizationTensor ParallelismHigh-Throughput SystemsLow-Latency OptimizationProduction DeploymentScalable InfrastructureImage GenerationAudio Processing

Questions & Answers

Common questions about this position

What is the salary range for this position?

The salary range is $325K - $490K.

Is this role remote or does it require office work?

This information is not specified in the job description.

What skills are required for this Software Engineer role?

Required skills include experience building and scaling inference systems for LLMs or multimodal models, working with GPU-based ML workloads especially with images or audio, familiarity with inference tooling like vLLM or TensorRT-LLM, and handling systems spanning networking, distributed compute, and high-throughput data.

What is the team like at OpenAI's Inference team?

The team is small, fast-moving, and focused on delivering world-class developer experience while pushing AI boundaries, partnering closely with Research, and expanding into multimodal inference infrastructure.

What makes a strong candidate for this role?

Strong candidates have experience with inference systems for LLMs or multimodal models, GPU-based ML workloads with images/audio, enjoy experimental fast-evolving work, collaborate closely with research, own problems end-to-end, and thrive in ambiguous spaces.

OpenAI

Develops safe and beneficial AI technologies

About OpenAI

OpenAI develops and deploys artificial intelligence technologies aimed at benefiting humanity. The company creates advanced AI models capable of performing various tasks, such as automating processes and enhancing creativity. OpenAI's products, like Sora, allow users to generate videos from text descriptions, showcasing the versatility of its AI applications. Unlike many competitors, OpenAI operates under a capped profit model, which limits the profits it can make and ensures that excess earnings are redistributed to maximize the social benefits of AI. This commitment to safety and ethical considerations is central to its mission of ensuring that artificial general intelligence (AGI) serves all of humanity.

San Francisco, CaliforniaHeadquarters

2015Year Founded

$18,433.2MTotal Funding

LATE_VCCompany Stage

AI & Machine LearningIndustries

1,001-5,000Employees

Benefits

Health insurance

Dental and vision insurance

Flexible spending account for healthcare and dependent care

Mental healthcare service

Fertility treatment coverage

401(k) with generous matching

20-week paid parental leave

Life insurance (complimentary)

AD&D insurance (complimentary)

Short-term/long-term disability insurance (complimentary)

Optional buy-up life insurance

Flexible work hours and unlimited paid time off (we encourage 4+ weeks per year)

Annual learning & development stipend

Regular team happy hours and outings

Daily catered lunch and dinner

Travel to domestic conferences

Risks

Elon Musk's legal battle may pose financial and reputational challenges for OpenAI.

Customizable ChatGPT personas could lead to privacy and ethical concerns.

Competitors like Anthropic raising capital may intensify market competition.

Differentiation

OpenAI's capped profit model prioritizes ethical AI development over unlimited profit.

OpenAI's AI models, like Sora, offer unique video creation from text descriptions.

OpenAI's focus on AGI aims to create AI systems smarter than humans.

Upsides

OpenAI's $6.6 billion funding boosts its AI research and computational capacity.

Customizable ChatGPT personas enhance user engagement and satisfaction.

OpenAI's 'Operator' AI agent could revolutionize workforce automation by 2025.

Land your dream remote job 3x faster with AI

Try Jobo Free