Machine Learning Engineer - Perception Offline Driving Intelligence at Zoox

Foster City, California, United States

Zoox Logo
Not SpecifiedCompensation
Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
Autonomous Vehicles, RoboticsIndustries

Requirements

  • MS or PhD in Computer Science, Machine Learning, or related technical field
  • Demonstrated experience training and deploying large language models (LLMs)
  • Experience building and maintaining ML training pipelines, including data preprocessing, model training, and evaluation
  • Proficiency in Python and ML libraries (PyTorch, NumPy) demonstrated through professional or research projects
  • Experience training models with large scale data
  • Bonus Qualifications
  • Publications in top-tier conferences (CVPR, ICCV, RSS, ICRA)
  • Experience with autonomous robotics systems

Responsibilities

  • Develop multimodal large language models that enhance our robotaxis' understanding of complex urban environments
  • Implement model architectures and sophisticated training techniques
  • Build large high quality datasets leveraging all the inputs from our sensor stack and the overall large scale data we have at Zoox
  • Drive end-to-end ML solutions from research to production, utilizing Zoox's extensive data pipelines and infrastructure to improve autonomous driving capabilities
  • Collaborate with perception, planning, safety, and systems teams to integrate your models into the vehicle's decision-making pipeline
  • Validate and optimize your solutions using real-world driving scenarios, directly contributing to the safety and reliability of Zoox's autonomous system

Skills

Key technologies and capabilities for this role

LLMsMultimodal ModelsModel TrainingModel Fine-tuningDataset BuildingML PipelinesSensor DataAutonomous DrivingPerception SystemsModel Deployment

Questions & Answers

Common questions about this position

What is the salary range for the Machine Learning Engineer position?

The base salary range is $180,000 - $256,000 a year. Compensation also includes Amazon Restricted Stock Units (RSUs), Zoox Stock Appreciation Rights, and possibly a sign-on bonus, varying by location, level, experience, and performance.

Is this Machine Learning Engineer role remote or office-based?

This information is not specified in the job description.

What skills are required for the Machine Learning Engineer role?

Required qualifications include an MS or PhD in Computer Science, Machine Learning, or related field, experience training and deploying large language models (LLMs), building ML training pipelines, and proficiency in Python and ML libraries like PyTorch and NumPy.

What is the team culture like for the ODIN team at Zoox?

The ODIN team leverages the latest AI to craft algorithms for self-driving robots, working alongside world-class engineers and researchers using premium sensor data and cutting-edge infrastructure to impact safety and productivity.

What makes a strong candidate for this Machine Learning Engineer position?

Strong candidates have an MS or PhD in a relevant field, proven experience with LLMs and ML pipelines, Python/PyTorch proficiency, and bonus points for publications in top conferences or autonomous robotics experience.

Zoox

Develops autonomous electric ride-hailing vehicles

About Zoox

Zoox focuses on creating a fully integrated autonomous ride-hailing service designed specifically for urban transportation. Unlike other companies that modify existing vehicles for self-driving capabilities, Zoox has engineered its own vehicle from the ground up, optimizing it for safety, efficiency, and passenger comfort. The vehicle features advanced sensors, cameras, and AI systems that allow it to navigate complex city environments. It can carry up to four passengers in a spacious interior, ensuring a pleasant ride experience. Safety is paramount, with rigorous testing and collaboration with regulatory bodies to meet high standards. Additionally, Zoox's vehicles are fully electric, promoting sustainability by reducing emissions. The company also develops a user-friendly ride-hailing platform that uses data analytics to improve routing and reduce wait times. Zoox aims to enhance urban mobility while prioritizing safety and environmental responsibility.

Menlo Park, CaliforniaHeadquarters
2014Year Founded
$1,206.2MTotal Funding
ACQUISITIONCompany Stage
Automotive & Transportation, Energy, AI & Machine LearningIndustries
1,001-5,000Employees

Benefits

Health Insurance
Maternity & Paternity Leave
Vacation & Paid Time Off
Sick Days
Free Lunch or Snacks
Employee Assitance Program

Risks

Increased competition from Waymo and Cruise may impact Zoox's market share.
Expansion into new cities introduces regulatory and operational challenges for Zoox.
Partnership with Williams Racing may divert focus from core vehicle development.

Differentiation

Zoox designs vehicles specifically for autonomous operation, unlike retrofitting existing cars.
Zoox's vehicles feature a unique, futuristic design with advanced AI systems.
Zoox offers a fully integrated ride-hailing service optimized for safety and efficiency.

Upsides

Zoox's expansion into Austin and Miami opens new markets and data collection opportunities.
Partnership with Williams Racing boosts Zoox's brand visibility in the U.S. market.
Hiring former Tesla executive Gao could accelerate Zoox's technological advancements.

Land your dream remote job 3x faster with AI