Senior/Staff Machine Learning Engineer - Perception Offline Driving Intelligence at Zoox

Foster City, California, United States

Zoox Logo
Not SpecifiedCompensation
Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level
Full TimeJob Type
UnknownVisa
Autonomous Vehicles, AIIndustries

Requirements

  • MS or PhD in Computer Science, Machine Learning, or related technical field
  • Demonstrated experience training and deploying large language models (LLMs)
  • Experience building and maintaining ML training pipelines, including data preprocessing, model training, and evaluation
  • Proficiency in Python and ML libraries (PyTorch, NumPy) demonstrated through professional or research projects
  • Experience training with large scale datasets (e.g. tens of millions of videos)
  • Bonus Qualifications
  • Publications in top-tier conferences (CVPR, ICCV, RSS, ICRA)
  • Experience with autonomous robotics systems

Responsibilities

  • Lead the development of multimodal large language models that enhance our robotaxis' understanding of complex urban environments
  • Design effective model architectures and sophisticated training techniques, leveraging all the inputs from our sensor stack and the overall large scale data we have at Zoox
  • Drive end-to-end ML solutions from research to production, utilizing Zoox's extensive data pipelines and infrastructure to improve autonomous driving capabilities
  • Collaborate with perception, planning, safety, and systems teams to integrate your models into the vehicle's decision-making pipeline
  • Validate and optimize your solutions using real-world driving scenarios, directly contributing to the safety and reliability of Zoox's autonomous system

Skills

Key technologies and capabilities for this role

Large Language ModelsLLMsMultimodal ModelsML Training PipelinesModel ArchitecturesFine-tuningSensor StackData PipelinesEnd-to-End MLAutonomous Driving

Questions & Answers

Common questions about this position

What is the salary range for this position?

The salary range is $230,000 - $332,000 a year.

Is this a remote position or does it require office work?

This information is not specified in the job description.

What skills are required for this Senior/Staff Machine Learning Engineer role?

Required skills include an MS or PhD in Computer Science, Machine Learning, or related field, experience training and deploying large language models (LLMs), building ML training pipelines, and proficiency in Python and ML libraries like PyTorch and NumPy.

What is the team culture like at Zoox's ODIN team?

The ODIN team consists of world-class engineers and researchers leveraging premium sensor data and cutting-edge infrastructure, with a collaborative environment working alongside perception, planning, safety, and systems teams.

What makes a strong candidate for this role?

Strong candidates will have an advanced degree in a relevant field, proven experience with LLMs and large-scale ML pipelines, Python proficiency, and bonus points for publications in top conferences or autonomous robotics experience.

Zoox

Develops autonomous electric ride-hailing vehicles

About Zoox

Zoox focuses on creating a fully integrated autonomous ride-hailing service designed specifically for urban transportation. Unlike other companies that modify existing vehicles for self-driving capabilities, Zoox has engineered its own vehicle from the ground up, optimizing it for safety, efficiency, and passenger comfort. The vehicle features advanced sensors, cameras, and AI systems that allow it to navigate complex city environments. It can carry up to four passengers in a spacious interior, ensuring a pleasant ride experience. Safety is paramount, with rigorous testing and collaboration with regulatory bodies to meet high standards. Additionally, Zoox's vehicles are fully electric, promoting sustainability by reducing emissions. The company also develops a user-friendly ride-hailing platform that uses data analytics to improve routing and reduce wait times. Zoox aims to enhance urban mobility while prioritizing safety and environmental responsibility.

Menlo Park, CaliforniaHeadquarters
2014Year Founded
$1,206.2MTotal Funding
ACQUISITIONCompany Stage
Automotive & Transportation, Energy, AI & Machine LearningIndustries
1,001-5,000Employees

Benefits

Health Insurance
Maternity & Paternity Leave
Vacation & Paid Time Off
Sick Days
Free Lunch or Snacks
Employee Assitance Program

Risks

Increased competition from Waymo and Cruise may impact Zoox's market share.
Expansion into new cities introduces regulatory and operational challenges for Zoox.
Partnership with Williams Racing may divert focus from core vehicle development.

Differentiation

Zoox designs vehicles specifically for autonomous operation, unlike retrofitting existing cars.
Zoox's vehicles feature a unique, futuristic design with advanced AI systems.
Zoox offers a fully integrated ride-hailing service optimized for safety and efficiency.

Upsides

Zoox's expansion into Austin and Miami opens new markets and data collection opportunities.
Partnership with Williams Racing boosts Zoox's brand visibility in the U.S. market.
Hiring former Tesla executive Gao could accelerate Zoox's technological advancements.

Land your dream remote job 3x faster with AI