Twelve Labs

ML Research Engineer

San Francisco, California, United States

Not SpecifiedCompensation
Mid-level (3 to 4 years), Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
AI & Machine Learning, Data & AnalyticsIndustries

Requirements

Candidates should have 6+ years of industry experience and a passion for both ML modeling and ML/AI systems software engineering. Strong expertise in Python is required, along with considerable prior work history with at least one statically typed language, preferably Golang. An applied bent is essential as this role is in an applied science and engineering group.

Responsibilities

As an ML Research Engineer, you will deliver applied research solutions for problems like VLM finetuning and auto-labeling of video-text datasets. You will collaborate with the science organization to optimize the training/inference performance of core model stacks and define a systematic prompt generation strategy for the flagship VLM. Additionally, you will work across teams to manage project priorities and drive technical initiatives from ideation to execution.

Skills

ML
Research
Video Embedding
Retrieval
Multimodal Language Modeling
VLM
Finetuning
Auto-labeling
Model-based Filtering
Prompt Generation
Training
Inference
Python
Data Analysis

Twelve Labs

AI system for video content understanding

About Twelve Labs

Twelve Labs focuses on artificial intelligence and video understanding by developing a system that analyzes videos to extract key features like actions, objects, and speech. This information is transformed into vector representations, enabling fast semantic search within large video datasets. The company differentiates itself by providing a platform that is faster and more effective than many existing models, allowing developers and product managers to easily integrate its technology through an API. Twelve Labs aims to make all videos searchable, enhancing the way businesses utilize video content.

Key Metrics

San Francisco, CaliforniaHeadquarters
2021Year Founded
$104.2MTotal Funding
EARLY_VCCompany Stage
Enterprise Software, AI & Machine Learning, EducationIndustries
51-200Employees

Risks

Increased competition from emerging AI startups in video understanding.
Rapid AI advancements require continuous innovation, straining resources.
Potential over-reliance on key investors like SK Telecom and Databricks.

Differentiation

Twelve Labs offers a comprehensive AI system for multimodal video understanding.
Their technology transforms video content into vector representations for fast semantic search.
The platform's API allows easy integration into clients' systems with minimal effort.

Upsides

Growing demand for AI-driven video analytics in education, healthcare, and security sectors.
Recent $30 million funding enhances technology development and strategic partnerships.
Collaboration with cloud providers boosts scalability and efficiency of video processing.

Land your dream remote job 3x faster with AI