Software Engineer, Inference – AMD GPU Enablement at OpenAI

San Francisco, California, United States

Apply Now

$325,000 – $490,000Compensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

Artificial Intelligence, TechnologyIndustries

Requirements

Experience writing or porting GPU kernels using HIP, CUDA, or Triton, and care deeply about low-level performance
Familiar with communication libraries like NCCL/RCCL and understand their role in high-throughput model serving
Worked on distributed inference systems and comfortable scaling models across fleets of accelerators
Enjoy solving end-to-end performance challenges across hardware, system libraries, and orchestration layers
Excited to be part of a small, fast-moving team building new infrastructure from first principles

Responsibilities

Own bring-up, correctness and performance of the OpenAI inference stack on AMD hardware
Integrate internal model-serving infrastructure (e.g., vLLM, Triton) into a variety of GPU-backed systems
Debug and optimize distributed inference workloads across memory, network, and compute layers
Validate correctness, performance, and scalability of model execution on large GPU clusters
Collaborate with partner teams to design and optimize high-performance GPU kernels for accelerators using HIP, Triton, or other performance-focused frameworks
Collaborate with partner teams to build, integrate and tune collective communication libraries (e.g., RCCL) used to parallelize model execution across many GPUs

Skills

Key technologies and capabilities for this role

AMD GPUHIPTritonvLLMRCCLGPU kernelsdistributed inferenceperformance optimization

Questions & Answers

Common questions about this position

What is the salary range for this position?

The salary range is $325K - $490K.

Is this a remote position or does it require office work?

This information is not specified in the job description.

What skills are required for this Software Engineer role?

Required skills include experience writing or porting GPU kernels using HIP, CUDA, or Triton, familiarity with communication libraries like NCCL/RCCL, and experience with distributed inference systems scaling models across accelerators.

What is the team like at OpenAI for this role?

This is a small, fast-moving team forming to generalize the inference stack for alternative hardware like AMD GPUs, working closely with research, infra, and performance teams.

What makes a strong candidate for this position?

Strong candidates have experience with GPU kernels (HIP, CUDA, Triton), communication libraries (NCCL/RCCL), distributed inference, and enjoy solving end-to-end performance challenges in a small team; nice-to-haves include open-source contributions to RCCL, Triton, or vLLM.

OpenAI

Develops safe and beneficial AI technologies

About OpenAI

OpenAI develops and deploys artificial intelligence technologies aimed at benefiting humanity. The company creates advanced AI models capable of performing various tasks, such as automating processes and enhancing creativity. OpenAI's products, like Sora, allow users to generate videos from text descriptions, showcasing the versatility of its AI applications. Unlike many competitors, OpenAI operates under a capped profit model, which limits the profits it can make and ensures that excess earnings are redistributed to maximize the social benefits of AI. This commitment to safety and ethical considerations is central to its mission of ensuring that artificial general intelligence (AGI) serves all of humanity.

San Francisco, CaliforniaHeadquarters

2015Year Founded

$18,433.2MTotal Funding

LATE_VCCompany Stage

AI & Machine LearningIndustries

1,001-5,000Employees

Benefits

Health insurance

Dental and vision insurance

Flexible spending account for healthcare and dependent care

Mental healthcare service

Fertility treatment coverage

401(k) with generous matching

20-week paid parental leave

Life insurance (complimentary)

AD&D insurance (complimentary)

Short-term/long-term disability insurance (complimentary)

Optional buy-up life insurance

Flexible work hours and unlimited paid time off (we encourage 4+ weeks per year)

Annual learning & development stipend

Regular team happy hours and outings

Daily catered lunch and dinner

Travel to domestic conferences

Risks

Elon Musk's legal battle may pose financial and reputational challenges for OpenAI.

Customizable ChatGPT personas could lead to privacy and ethical concerns.

Competitors like Anthropic raising capital may intensify market competition.

Differentiation

OpenAI's capped profit model prioritizes ethical AI development over unlimited profit.

OpenAI's AI models, like Sora, offer unique video creation from text descriptions.

OpenAI's focus on AGI aims to create AI systems smarter than humans.

Upsides

OpenAI's $6.6 billion funding boosts its AI research and computational capacity.

Customizable ChatGPT personas enhance user engagement and satisfaction.

OpenAI's 'Operator' AI agent could revolutionize workforce automation by 2025.

Land your dream remote job 3x faster with AI

Try Jobo Free