Staff Software Engineer, Managed AI at Crusoe

San Francisco, California, United States

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level

Full TimeJob Type

UnknownVisa

AI, Cloud Infrastructure, TechnologyIndustries

Requirements

Advanced degree in Computer Science, Engineering, or a related field
Demonstrable experience in distributed systems design and implementation
Proven track record of delivering early-stage projects under tight deadlines
Expertise in using cloud-based services, such as elastic compute, object storage, virtual private networks, managed databases, etc
Experience in Generative AI (Large Language Models, Multimodal)
Familiarity with AI infrastructure, including training, inference, and ETL pipelines
Experience with container runtimes (e.g., Kubernetes) and microservices architectures
Experience using REST APIs and common communication protocols, such as gRPC
Demonstrated experience in the software development cycle and familiarity with CI/CD tools
Proactive and collaborative approach with the ability to work autonomously
Strong communication and interpersonal skills
Passion for building cutting-edge AI infrastructure
Preferred Qualifications
Proficiency in Golang or Python for large-scale, production-level services
Contributions to open-source AI projects such as VLLM or similar frameworks
Performance optimizations on GPU systems and inference frameworks

Responsibilities

Lead the design and implementation of core AI services, including resilient fault-tolerant queues for efficient task distribution
Lead the design and implementation of model catalogs for managing and versioning AI models
Lead the design and implementation of scheduling mechanisms optimized for cost and performance
Lead the design and implementation of high-performance APIs for serving AI models to customers
Build and scale infrastructure to handle millions of API requests per second
Optimize AI inference performance on GPU-based systems
Implement robust monitoring and alerting to ensure system health and availability
Collaborate closely with product management, business strategy, and other engineering teams
Influence the long-term vision and architectural decisions of the AI platform
Contribute to open-source AI frameworks and participate in the AI community
Prototype and iterate on new features and technologies

Skills

Key technologies and capabilities for this role

Distributed SystemsFault-Tolerant QueuesModel CatalogsScheduling MechanismsAI InferenceLLMsScalable InfrastructureAPI Development

Questions & Answers

Common questions about this position

What is the salary for this Staff Software Engineer position?

This information is not specified in the job description.

Is this role remote or hybrid, and where is it located?

The position is hybrid.

What skills and experience are required for this role?

Candidates need an advanced degree in Computer Science, Engineering, or a related field, demonstrable experience in distributed systems design and implementation, and a proven track record of delivering early-stage projects.

What is the team and work environment like at Crusoe?

You'll join a dynamic, fast-growing team where you'll collaborate cross-functionally with product management, business strategy, and other engineering teams to influence the long-term vision of the AI platform.

What makes a strong candidate for this Staff Software Engineer role?

A strong candidate will have strong engineering fundamentals including an advanced degree, experience in distributed systems, and a track record of delivering early-stage projects, along with the ability to lead design of core AI services like queues, model catalogs, and scheduling.

Crusoe

Utilizes wasted energy for computing power

About Crusoe

Crusoe Energy Systems Inc. provides digital infrastructure that focuses on using wasted, stranded, or clean energy sources to power high-performance computing and artificial intelligence. The company helps clients in the technology and energy sectors by offering scalable computing solutions that aim to reduce greenhouse gas emissions and support the transition to cleaner energy. Crusoe's approach involves converting excess natural gas and renewable energy into computing power, which allows them to maximize resource efficiency while minimizing environmental impact. Unlike many competitors, Crusoe specifically targets the intersection of energy and technology, generating revenue by supplying computing resources to enterprises that need significant computational power for applications like AI and machine learning, along with providing technical support.

Denver, ColoradoHeadquarters

2018Year Founded

$1,082.2MTotal Funding

SERIES_DCompany Stage

Energy, AI & Machine LearningIndustries

201-500Employees