Senior Software Engineer, Managed AI at Crusoe

San Francisco, California, United States

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

AI, Cloud InfrastructureIndustries

Requirements

Advanced degree in Computer Science, Engineering, or a related field
Proven experience in distributed systems design and implementation
Expertise in using cloud-based services, such as elastic compute, object storage, virtual private networks, managed databases, etc
Experience with container runtimes (e.g., Kubernetes) and microservices architectures
Experience using REST APIs and common communication protocols, such as gRPC
Demonstrated experience in the software development cycle and familiarity with CI/CD tools
Experience in Generative AI (Large Language Models, Multimodal)
Proficiency in Golang or Python for large-scale, production-level services. (Preferred)
Familiarity with AI infrastructure, including training, inference, and ETL pipelines. (Preferred)
Contributions to open-source AI projects such as VLLM or similar frameworks. (Preferred)
Performance optimizations on GPU systems and inference frameworks. (Preferred)
Proven track record of delivering early-stage projects

Responsibilities

Design and develop core infrastructure for the Managed AI platform
Lead the design and implementation of resilient fault-tolerant queues, model catalogs, and scheduling mechanisms
Build and optimize systems for high-volume AI inference, handling millions of API requests per second
Develop and maintain core services for AI model deployment and management
Work closely with product managers, data scientists, and other engineers to define and deliver AI services
Integrate with other Crusoe Cloud services to provide a seamless user experience
Collaborate with research and development teams to explore and implement new AI technologies
Design and implement systems with high availability, low latency, and fault tolerance
Optimize performance across all stages of the AI inference pipeline, including model loading, execution, and response handling
Continuously monitor and improve the performance and reliability of AI services

Skills

AI Inference

Fault-Tolerant Queues

Model Catalogs

Scheduling Mechanisms

Scalable Infrastructure

LLMs

API Systems

Distributed Systems

Crusoe

Utilizes wasted energy for computing power

About Crusoe

Crusoe Energy Systems Inc. provides digital infrastructure that focuses on using wasted, stranded, or clean energy sources to power high-performance computing and artificial intelligence. The company helps clients in the technology and energy sectors by offering scalable computing solutions that aim to reduce greenhouse gas emissions and support the transition to cleaner energy. Crusoe's approach involves converting excess natural gas and renewable energy into computing power, which allows them to maximize resource efficiency while minimizing environmental impact. Unlike many competitors, Crusoe specifically targets the intersection of energy and technology, generating revenue by supplying computing resources to enterprises that need significant computational power for applications like AI and machine learning, along with providing technical support.

Denver, ColoradoHeadquarters

2018Year Founded

$1,082.2MTotal Funding

SERIES_DCompany Stage

Energy, AI & Machine LearningIndustries

201-500Employees