Senior Data Engineer
Rad AI145,000 - 190,000 USD/year
- Full Time
- Senior (5 to 8 years)
$180,000 – $250,000Compensation
Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
AI & Machine Learning, Data & AnalyticsIndustries
Requirements
Candidates should have at least 5 years of engineering experience, including 2 years in petabyte-level data processing. A very strong generalist Python coding skill is required, along with a deep understanding of Kubernetes, SLURM, Ray, and other cluster orchestration systems. Experience with visual data and working closely with machine learning is a strong plus.
Responsibilities
The Senior Software Engineer will design, build, and automate infrastructure for processing data across multiple clusters of thousands of GPUs. They will work with researchers to identify and implement technical data requirements and optimize distributed loading for model training. The role also involves cross-functional collaboration to address diverse backend engineering needs and creating performant infrastructure to manage and leverage large-scale datasets for model training.
Skills
Python
Kubernetes
SLURM
Ray
Data Processing
Petabyte-level data
Luma AI
Develops multimodal AI technologies for creativity
About Luma AI
Luma AI develops multimodal artificial intelligence technologies that enhance human creativity and capabilities. Their main product, the Dream Machine, allows users to interact with various types of data, enabling creative professionals, businesses, and developers to explore innovative applications of AI. Unlike many competitors, Luma AI focuses on integrating multiple modes of interaction, which broadens the possibilities for users. The company operates on a subscription model, providing access to its AI tools and services, and aims to lead the way in AI-driven creativity and productivity.
Key Metrics
San Francisco, CaliforniaHeadquarters
2021Year Founded
$84.9MTotal Funding
LATE_VCCompany Stage
Consumer Software, AI & Machine LearningIndustries
51-200Employees