Manager, Multi-Modal LLM Applications at Zoox

Foster City, California, United States

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level

Full TimeJob Type

UnknownVisa

Autonomous Vehicles, AI, RoboticsIndustries

Requirements

5+ years of professional experience in Machine Learning or Deep Learning, with a focus on large-scale model applications
3+ years of experience leading and managing engineering or research teams focused on AI/ML
Direct experience leading teams training Multi-Modal Large Language Models (MLLMs), with deep expertise in post-training techniques (e.g., instruction tuning, alignment, domain adaptation)
Proven track record of deploying ML/MLLM models to production or internal customers to solve complex, real-world problems, ideally within the autonomy or robotics domain
Strong organizational skills to manage complex project schedules, staffing needs, and priorities effectively
A passion for mentoring and developing high-performing team members

Responsibilities

Lead and manage a team of talented Machine Learning Engineers specializing in MLLMs for concrete applications
Oversee the full lifecycle of MLLM development, with a specific focus on post-training methodologies (e.g., fine-tuning, RLHF, context engineering) to optimize models for autonomy tasks
Drive the deployment of complex MLLM solutions to internal customers, specifically solving tangible offline autonomy problems within the Zoox ecosystem
Understand and identify dependencies between your team's work and other engineering teams and domains (e.g., Perception, Prediction, Planning, Validation). Collaborate with functional peer managers to ensure alignment and cooperation
Proactively create development opportunities for team members, coaching and mentoring them to grow their technical and leadership skills. Estimate staffing needs and schedules and assign project work to drive efficiency and meet operational goals
Establish team goals and priorities and execute against operational needs. Apply and improve upon existing processes and procedures to resolve functional problems for the team
Identify issues, gather facts, and execute analysis of situations or data to inform strategy and decisions
Manage special projects and initiatives and frequently conduct presentations of key information to gain the cooperation of others
Leverage broad knowledge of the specialized field/discipline to analyze complex information. Recommend and collaborate with senior management to resolve strategic issues

Skills

Key technologies and capabilities for this role

Multi-Modal LLMMLLMMachine LearningFine-tuningRLHFContext EngineeringModel DeploymentAutonomous DrivingPerceptionPredictionPlanningValidation

Questions & Answers

Common questions about this position

What experience is required for the Manager, Multi-Modal LLM Applications role?

Candidates need 5+ years of professional experience in Machine Learning or Deep Learning with a focus on large-scale model applications, and 3+ years leading and managing engineering or research teams focused on AI/ML, plus direct experience leading teams training Multi-Modal Large Language Models.

What are the main responsibilities of this position?

The role involves leading a team of Machine Learning Engineers specializing in MLLMs, overseeing model development and deployment with a focus on post-training methodologies, driving deployment to internal customers for autonomy problems, collaborating cross-functionally, and managing people development and operational execution.

What is the salary or compensation for this role?

This information is not specified in the job description.

Is this position remote or does it require office work?

This information is not specified in the job description.

What is the company culture like at Zoox?

Zoox has a passionate, collaborative, and fast-moving team environment focused on building a revolutionary new mobility experience with fully autonomous vehicles.

Zoox

Develops autonomous electric ride-hailing vehicles

About Zoox

Zoox focuses on creating a fully integrated autonomous ride-hailing service designed specifically for urban transportation. Unlike other companies that modify existing vehicles for self-driving capabilities, Zoox has engineered its own vehicle from the ground up, optimizing it for safety, efficiency, and passenger comfort. The vehicle features advanced sensors, cameras, and AI systems that allow it to navigate complex city environments. It can carry up to four passengers in a spacious interior, ensuring a pleasant ride experience. Safety is paramount, with rigorous testing and collaboration with regulatory bodies to meet high standards. Additionally, Zoox's vehicles are fully electric, promoting sustainability by reducing emissions. The company also develops a user-friendly ride-hailing platform that uses data analytics to improve routing and reduce wait times. Zoox aims to enhance urban mobility while prioritizing safety and environmental responsibility.

Menlo Park, CaliforniaHeadquarters

2014Year Founded

$1,206.2MTotal Funding

ACQUISITIONCompany Stage

Automotive & Transportation, Energy, AI & Machine LearningIndustries

1,001-5,000Employees

Benefits

Health Insurance

Maternity & Paternity Leave

Vacation & Paid Time Off

Sick Days

Free Lunch or Snacks

Employee Assitance Program

Risks

Increased competition from Waymo and Cruise may impact Zoox's market share.

Expansion into new cities introduces regulatory and operational challenges for Zoox.

Partnership with Williams Racing may divert focus from core vehicle development.

Differentiation

Zoox designs vehicles specifically for autonomous operation, unlike retrofitting existing cars.

Zoox's vehicles feature a unique, futuristic design with advanced AI systems.

Zoox offers a fully integrated ride-hailing service optimized for safety and efficiency.

Upsides

Zoox's expansion into Austin and Miami opens new markets and data collection opportunities.

Partnership with Williams Racing boosts Zoox's brand visibility in the U.S. market.

Hiring former Tesla executive Gao could accelerate Zoox's technological advancements.

Land your dream remote job 3x faster with AI

Try Jobo Free