Member of Technical Staff, Agent Infrastructure Engineer
CohereSalary not specified
- Full Time
- Mid-level (3 to 4 years), Senior (5 to 8 years)
Not SpecifiedCompensation
Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
Semiconductors, Artificial Intelligence, AI & Machine Learning, Software DevelopmentIndustries
Requirements
Candidates should possess a Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related field, or equivalent experience. They must have at least six years of demonstrated experience in developing performant microservices, cloud software, and/or tooling roles. Strong experience with distributed containerized applications using Docker and Kubernetes is required, along with expertise in building and deploying containers for microservices, cloud, and on-prem deployments, including CI/CD pipelines. A history of using advanced programming skills to build distributed compute systems, backend services, and multi-functional teams is also necessary.
Responsibilities
The Senior Software Engineer will design, build, and optimize containerized inference execution for LLM applications, ensuring efficiency and scalability. They will ensure the performance and scalability of NIMs through comprehensive performance measurement and optimization, applying container expertise to create and optimize the basic building blocks of NIMs. The role involves collaborating with a broad team of engineers, researchers, SREs, and product management to improve inference solutions and APIs, and mentoring team members and other teams to foster growth. Additionally, they will debug and analyze the performance of distributed microservices or cloud systems and demonstrate a passion for building scalable and performant microservice applications.
Skills
Containerization
Kubernetes
Docker
Performance Optimization
Inference Engines
Microservices
Scalability
Log Ingestion
Metrics
Performance Engineering
API Design
Distributed Systems
NVIDIA
Designs GPUs and AI computing solutions
About NVIDIA
NVIDIA designs and manufactures graphics processing units (GPUs) and system on a chip units (SoCs) for various markets, including gaming, professional visualization, data centers, and automotive. Their products include GPUs tailored for gaming and professional use, as well as platforms for artificial intelligence (AI) and high-performance computing (HPC) that cater to developers, data scientists, and IT administrators. NVIDIA generates revenue through the sale of hardware, software solutions, and cloud-based services, such as NVIDIA CloudXR and NGC, which enhance experiences in AI, machine learning, and computer vision. What sets NVIDIA apart from competitors is its strong focus on research and development, allowing it to maintain a leadership position in a competitive market. The company's goal is to drive innovation and provide advanced solutions that meet the needs of a diverse clientele, including gamers, researchers, and enterprises.
Key Metrics
Santa Clara, CaliforniaHeadquarters
1993Year Founded
$19.5MTotal Funding
IPOCompany Stage
Automotive & Transportation, Enterprise Software, AI & Machine Learning, GamingIndustries
10,001+Employees