Infrastructure Software Engineer
Baseten$150,000 - $200,000/year
- Full Time
- Junior (1 to 2 years)
Not SpecifiedCompensation
Mid-level (3 to 4 years), Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
AI & Machine Learning, Enterprise SoftwareIndustries
Position Overview
- Location Type: Remote
- Employment Type: Full-Time
- Salary: Not provided
Cohere is a company focused on scaling intelligence to serve humanity, training and deploying frontier models for developers and enterprises. They emphasize a collaborative environment, a high ratio of compute to engineers, and a blend of engineering and research. The goal is to build AI systems for content generation, semantic search, RAG, and agents.
Requirements
- Strong Software Engineering Skills: A solid foundation in software development principles.
- Python Proficiency: Expertise in the Python programming language.
- ML Frameworks: Experience with machine learning frameworks such as JAX, Pytorch, and XLA/MLIR.
- Distributed Training Infrastructure: Experience with distributed training infrastructures (Kubernetes, Slurm) and associated frameworks (Ray).
- Large-Scale Distributed Training: Hands-on experience training large models at scale.
- Contribution to Training Infrastructure: Experience contributing to the tooling and/or setup of training infrastructure.
Responsibilities
- Design and write high-performant software for model training.
- Improve the performance of the training infrastructure from an infrastructure and codebase perspective.
- Implement tools to accelerate training cycles and improve the efficacy of the training infrastructure.
- Research, implement, and experiment with ideas related to supercompute and data infrastructure.
- Learn from and work with top researchers in the field.
Bonus Qualifications
- Experience with publications at top-tier machine learning conferences (NeurIPS, ICML, ICLR, AIStats, MLSys, JMLR, AAAI, Nature, COLING, ACL, EMNLP).
Company Information
- Mission: To scale intelligence to serve humanity.
- Culture: Obsessive about building, collaborative, fast-paced, diverse perspectives valued.
- Location: Remote-friendly (offices in London, Toronto, San Francisco, New York).
- Team: A team of researchers, engineers, designers, and more.
Skills
Python
JAX
Pytorch
XLA/MLIR
Kubernetes
Slurm
Ray
Software Development
Distributed Training
Cohere
Provides NLP tools and LLMs via API
About Cohere
Cohere provides advanced Natural Language Processing (NLP) tools and Large Language Models (LLMs) through a user-friendly API. Their services cater to a wide range of clients, including businesses that want to improve their content generation, summarization, and search functions. Cohere's business model focuses on offering scalable and affordable generative AI tools, generating revenue by granting API access to pre-trained models that can handle tasks like text classification, sentiment analysis, and semantic search in multiple languages. The platform is customizable, enabling businesses to create smarter and faster solutions. With multilingual support, Cohere effectively addresses language barriers, making it suitable for international use.
Toronto, CanadaHeadquarters
2019Year Founded
$914.4MTotal Funding
SERIES_DCompany Stage
AI & Machine LearningIndustries
501-1,000Employees