Member of Technical Staff, JAX & Compiler at xAI

Palo Alto, California, United States

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level

Full TimeJob Type

UnknownVisa

AI, Machine LearningIndustries

Requirements

Located near the Bay Area or open to relocation to San Francisco/Palo Alto
Strong work ethic and prioritization skills
Strong communication skills for sharing knowledge concisely and accurately
Ideal experience in at least one of:
Deep knowledge of JAX core and its interaction with XLA compiler and runtime
Strong understanding of compiler optimizations (e.g., memory assignment, scheduling, fusions) and proficiency with distributed profiling tools like xprof
Hands-on experience training large-scale LLMs with JAX (on GPU or TPU) and applying parallelism strategies
Practical experience with kernel compilers such as Triton, Pallas, Mosaic, or CuteDSL
Excellent communication skills for collaboration with pretraining and reasoning teams
Proficiency in tech stack: Python/C++, JAX, XLA Compiler, MLIR Infrastructure

Responsibilities

Develop in-house JAX or compiler/runtime features for high-performance large-scale LLM training on hardware like Hopper and Grace Blackwell
Develop and use innovative toolings for debugging distributed programs, profiling train steps, and memory consumption over time
Understand CUDA runtime and its interactions with upper-level frameworks
Support a wide range of cutting-edge LLM research/production tasks
Be hands-on, contribute directly to the company’s mission, show initiative, and deliver excellence

Skills

Key technologies and capabilities for this role

PythonC++JAXXLAMLIRCUDACompiler OptimizationDistributed TrainingLLM TrainingGPUTPUxprof

Questions & Answers

Common questions about this position

What is the salary range for this position?

The annual salary range is $180,000 - $440,000 USD.

Is this role remote or does it require relocation?

The role is based in the Bay Area [San Francisco and Palo Alto]. Candidates are expected to be located near the Bay Area or open to relocation.

What skills and experience are required for this role?

Ideal experience includes at least one of: JAX/XLA expertise, compiler optimization with tools like xprof, distributed LLM training with JAX on GPU/TPU, kernel compiler experience with Triton/Pallas/etc., and excellent communication for collaboration. The tech stack involves Python/C++, JAX, XLA Compiler, and MLIR Infrastructure.

What is the company culture like at xAI?

xAI has a small, highly motivated team focused on engineering excellence, with a flat organizational structure where employees are hands-on, show initiative, and contribute directly to the mission. Strong work ethic, prioritization, and communication skills are valued.

What does the interview process involve?

After CV and statement review, there's a 15-minute phone interview, followed by four technical interviews: coding assessment, systems hands-on, project deep-dive, and team meet-and-greet, all via Google Meet, aiming to complete within one week.

xAI

AI tools for research and information retrieval

About xAI

x.ai develops AI tools aimed at enhancing research and information retrieval. Their main product, Grok, is designed to answer a variety of questions, including unconventional ones that other AI systems might not handle. Grok provides real-time knowledge, making it a useful resource for researchers, academics, and professionals who need quick access to relevant information. Unlike competitors, Grok stands out for its ability to suggest questions and provide nuanced answers, catering to a diverse range of inquiries. The goal of x.ai is to empower users by streamlining their research processes and fostering innovation through reliable information access.

Burlingame, CaliforniaHeadquarters

2023Year Founded

$11,803.1MTotal Funding

SERIES_CCompany Stage

Data & Analytics, AI & Machine LearningIndustries

1,001-5,000Employees