Tech Lead, AI Compute Infrastructure at HeyGen

Los Angeles, California, United States

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level

Full TimeJob Type

UnknownVisa

Artificial Intelligence, TechnologyIndustries

Requirements

Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience
5+ years of full-time industry experience in large-scale MLOps, AI infrastructure, or HPC systems
Experience with data frameworks and standards like Ray, Apache Spark, LanceDB
Strong proficiency in Python and a high-performance language such as C++ for developing core infrastructure components
Deep understanding and hands-on experience with modern orchestration and distributed computing frameworks such as Kubernetes and Ray
Experience with core ML frameworks such as PyTorch, TensorFlow, or JAX

Responsibilities

Optimize GPU Utilization: Design and implement mechanisms to aggressively optimize GPU and cluster utilization across thousands of devices for inference, training, data processing and large-scale deployment of our state-of-the-art video generation models
Develop Large-Scale AI Job Framework: Build highly scalable, reliable frameworks for launching and managing massive, heterogeneous compute jobs, including multi-modal high-volume data ingestion/processing, distributed model training, and continuous evaluation/benchmarking
Enhance Observability: Develop world-class observability, tracing, and visualization tools for our compute cluster to ensure reliability, diagnose performance bottlenecks (e.g., memory, bandwidth, communication)
Accelerate Pipelines: Collaborate closely with AI researchers and AI engineers to integrate innovative acceleration techniques (e.g., custom CUDA kernels, distributed training libraries) into production-ready, scalable training and inference pipelines
Infrastructure Management: Champion the adoption and optimization of modern cloud and container technologies (Kubernetes, Ray) for elastic, cost-efficient scaling of our distributed systems

Skills

Key technologies and capabilities for this role

GPU OptimizationCluster ManagementDistributed TrainingData PipelinesObservabilityTracingModel DeploymentPerformance BottlenecksAI InfrastructureJob Scheduling

Questions & Answers

Common questions about this position

What experience level is required for this Tech Lead role?

The position requires 5+ years of full-time industry experience in large-scale MLOps, AI infrastructure, or HPC systems.

What technical skills and tools are essential for this position?

Candidates need strong proficiency in Python and a high-performance language like C++, experience with data frameworks such as Ray, Apache Spark, LanceDB, and hands-on expertise with Kubernetes and distributed computing frameworks.

What is the salary or compensation for this role?

This information is not specified in the job description.

Is this position remote or does it require office work?

This information is not specified in the job description.

What education is required for this Tech Lead position?

A Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience is required.

HeyGen

AI video editor for professional content creation

About HeyGen

HeyGen provides an AI video editor that enables users to create professional spokesperson videos without needing human actors. The platform uses AI-generated avatars, allowing users to select from various virtual actors, apply automatic translations, and choose different accents to cater to diverse audiences. This service is particularly beneficial for small businesses, educational institutions, and marketing professionals who require high-quality video content quickly and affordably. Unlike traditional video production, which can be costly and time-consuming, HeyGen streamlines the process, making it accessible to a wider range of clients. The company operates on a subscription model, offering different service levels to accommodate both small and large enterprises, ensuring a steady revenue stream while providing continuous updates and customer support. HeyGen's goal is to simplify video content creation and meet the increasing demand for engaging digital content.

Los Angeles, CaliforniaHeadquarters

2020Year Founded

$72.6MTotal Funding

SERIES_ACompany Stage

Consumer Software, AI & Machine LearningIndustries

51-200Employees

Benefits

Health Insurance

Unlimited Paid Time Off

Parental Leave

Mental Health Support

401(k) Retirement Plan

Risks

Emerging competition from AI video platforms threatens HeyGen's market share.

AI voice cloning advancements may lead to regulatory challenges for HeyGen.

HeyGen faces ethical concerns over AI-generated misinformation and identity theft.

Differentiation

HeyGen uses AI to create videos without actors, cameras, or editing.

The platform offers automatic translations and diverse accents for global audience reach.

HeyGen's subscription model provides continuous updates and customer support.

Upsides

HeyGen raised $60M in Series A, valuing the company at $500M.

Partnerships with media companies expand HeyGen's market reach and applications.

Growing demand for AI-generated video content boosts HeyGen's market potential.

Land your dream remote job 3x faster with AI

Try Jobo Free