Senior Research engineer - Multimodal Language Models at Luma AI

Palo Alto, California, United States

Luma AI Logo
$200,000 – $300,000Compensation
Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
AI & Machine LearningIndustries

Skills

Key technologies and capabilities for this role

PythonPyTorchLLMsVision Language ModelsAudio Language ModelsGenerative Video ModelsData ProcessingData LoadingTrainingInferenceData VisualizationData FilteringDistributed Systems

Questions & Answers

Common questions about this position

What is the salary range for this position?

The base pay range is $200,000 - $300,000 per year in California, though base pay may vary.

Is this role remote or hybrid?

This is a hybrid position.

What skills are required for this Senior Research Engineer role?

Expertise in Python and PyTorch with full development pipeline experience is required, along with multimodal data experience processing large-scale text or interleaved audio/video/image/text data, and hands-on experience developing or benchmarking LLMs, Vision Language Models, Audio Language Models, or generative video models.

What benefits are offered?

The role includes competitive equity packages in the form of stock options and a comprehensive benefits plan.

What kind of experience stands out for applicants?

Candidates with significant experience solving hard problems in PyTorch, multimodal data, and distributed systems, plus hands-on work with LLMs, vision/audio language models, or generative video models, will be strongest.

Luma AI

Develops multimodal AI technologies for creativity

About Luma AI

Luma AI develops multimodal artificial intelligence technologies that enhance human creativity and capabilities. Their main product, the Dream Machine, allows users to interact with various types of data, enabling creative professionals, businesses, and developers to explore innovative applications of AI. Unlike many competitors, Luma AI focuses on integrating multiple modes of interaction, which broadens the possibilities for users. The company operates on a subscription model, providing access to its AI tools and services, and aims to lead the way in AI-driven creativity and productivity.

San Francisco, CaliforniaHeadquarters
2021Year Founded
$84.9MTotal Funding
LATE_VCCompany Stage
Consumer Software, AI & Machine LearningIndustries
51-200Employees

Benefits

Company Equity
Stock Options

Risks

Competition from Google's Veo 2 and OpenAI's Sora Turbo challenges Luma AI's market position.
AWS's cost-reducing features may make Luma AI's services less competitive.
AI-generated content controversies could harm Luma AI's reputation if outputs are misleading.

Differentiation

Luma AI transforms text into 3D models, enhancing user interaction with digital content.
The Dream Machine integrates multimodal AI, offering a unique creative platform for users.
Luma AI's Photon models provide high-quality, personalized image generation capabilities.

Upsides

Luma AI's $90 million funding boosts its capacity for innovation and market expansion.
Dream Machine 1.5's advanced text-to-video features attract creative professionals and businesses.
Expanding Dream Machine into a mobile app increases accessibility and user engagement.

Land your dream remote job 3x faster with AI