Senior Product Manager at Alluxio

Foster City, California, United States

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

AI, Data Services, Financial Services, High-Tech, Retail, TelecommunicationsIndustries

Requirements

4-8 years of experience in product management, AI infrastructure, or ML engineering roles, with at least 2 years focused on AI/ML workloads
Deep understanding of AI/ML workflows, including model deployment, inference optimization, and data-access patterns
Proven track record of delivering features with measurable improvements in latency, throughput, or GPU utilization, or equivalent experience
Technical proficiency in distributed systems and cloud platforms (Kubernetes, AWS/GCP/Azure) and familiarity with frameworks like PyTorch, TensorFlow, Triton Inference Server or similar
Excellent communication and cross-functional leadership skills, enabling clear translation of complex technical concepts to varied audiences

Responsibilities

Define product roadmaps for AI-inference workflows, focusing on latency, throughput, and GPU utilization improvements
Engage deeply with technical users to understand bottlenecks in model serving, caching, and scaling and translate them into product specifications
Partner with engineering to design and deliver inference-oriented features such as GPU scheduling, sharding, and streaming data access
Work with customers to validate features and measure their impact, incorporating feedback into iteration cycles
Stay current with AI infrastructure trends (hybrid clouds, edge inference, multi-model serving) and integrate them into product planning

Skills

Product Strategy

Product Roadmap

AI Inference

Machine Learning

LLMs

Generative AI

Computer Vision

NLP

Data Orchestration

Intelligent Caching

Unified Namespace

Big Data

Alluxio

Data management solutions for AI workloads

About Alluxio

Alluxio.io focuses on optimizing data management for Artificial Intelligence (AI) and Machine Learning (ML) workloads. It offers two main products: Alluxio Enterprise Data and Alluxio Enterprise AI, which help businesses manage their data and AI tasks across various infrastructure setups. By providing a single interface, Alluxio simplifies the management of data silos, enhances performance, and reduces the complexity of handling different technology stacks. Its solutions can accelerate model training by 20 times and model serving by 10 times, while also maximizing the return on investment for infrastructure and achieving high GPU utilization. Alluxio's goal is to help businesses improve efficiency and performance in their AI and ML operations by eliminating data copies and enabling seamless data access.

San Mateo, CaliforniaHeadquarters

2015Year Founded

$79.3MTotal Funding

SERIES_CCompany Stage

Data & Analytics, AI & Machine LearningIndustries

51-200Employees

Benefits

Unlimited PTO

Amazing Medical, Dental, and Vision Plans

Commuter Benefits ($50+)

Everyday Catered Lunch and Dinner

Boba Thursday

Relaxation/Massage Room Onsite

Gym Access

Frequent Company Outings and Trips

Risks

Increased competition could erode Alluxio's market share in AI data management.

Rapid technological advancements may render Alluxio's offerings obsolete if not updated.

Reliance on partnerships poses risks if expected synergies are not achieved.

Differentiation

Alluxio offers a memory-centric architecture for data storage and management.

The company provides a single interface for managing data and AI workloads.

Alluxio's solutions accelerate model training by 20 times and serving by 10 times.

Upsides

Growing demand for AI-optimized data platforms boosts Alluxio's market potential.

Recognition as a top open source project enhances Alluxio's brand reputation.

Partnership with NetApp expands Alluxio's market reach and collaborative opportunities.

Land your dream remote job 3x faster with AI

Try Jobo Free