Senior Software Engineer - AI Research Clusters at NVIDIA

Santa Clara, California, United States

NVIDIA Logo
Not SpecifiedCompensation
Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
Artificial Intelligence, Machine Learning, High-Performance ComputingIndustries

Requirements

  • BS/MS in Computer Science, Engineering, or equivalent experience
  • 8+ years in software/platform engineering, including 3+ years in ML infrastructure or distributed systems
  • Experience in software development lifecycle on Linux-based platforms
  • Strong coding skills in languages such as Python, C++ or Rust
  • Experience with Docker, Kubernetes, GitLab CI, automated deployments
  • Experience with AIOps or Agentic AI and apply it successfully in production environment

Responsibilities

  • Work with coworkers across the AI Platform organization to understand the pain points of validating, monitoring and operating GPU clusters at scale
  • Design, develop and maintain engineering solutions to solve those pain points systematically
  • Research in traditional AIOps and the emerging Agentic AI, and leverage it to further reduce the operation toil
  • Participate in on-call support for systems, platforms built and owned by the team
  • Propose and implement engineering solutions to ensure delivery of functional, reliable, secure, and performance-optimal GPU clusters to internal researchers
  • Enable researchers to focus on training and development by reducing operational disruption and overhead
  • Empower researchers for self-service continuous improvement on reliability, operational excellence & performance

Skills

Key technologies and capabilities for this role

PythonC++RustDockerKubernetesGitLab CILinuxAIOpsAgentic AIDistributed SystemsML InfrastructureAutomated Deployments

Questions & Answers

Common questions about this position

What is the salary range for this Senior Software Engineer position?

The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5, determined based on location, experience, and pay of employees in similar positions. You will also be eligible for equity and benefits.

Is this a remote position or does it require working in an office?

This information is not specified in the job description.

What skills and experience are required for this role?

Required qualifications include a BS/MS in Computer Science or Engineering, 8+ years in software/platform engineering with 3+ years in ML infrastructure or distributed systems, experience in software development lifecycle on Linux, strong coding in Python, C++ or Rust, Docker, Kubernetes, GitLab CI, automated deployments, and AIOps or Agentic AI in production.

What is the company culture like at NVIDIA?

NVIDIA is committed to fostering a diverse work environment and is proud to be an equal opportunity employer, highly valuing diversity in current and future employees without discrimination.

What makes a candidate stand out for this position?

Candidates stand out with proficiency in full-stack development including Relational Data Modeling, DB optimization, REST API, Javascript, CSS; passion for developer-centric platforms with great UX and reliability; experience with Slurm or custom schedulers in ML environments; and familiarity with GPU computing, Linux internals, and performance tuning at scale.

NVIDIA

Designs GPUs and AI computing solutions

About NVIDIA

NVIDIA designs and manufactures graphics processing units (GPUs) and system on a chip units (SoCs) for various markets, including gaming, professional visualization, data centers, and automotive. Their products include GPUs tailored for gaming and professional use, as well as platforms for artificial intelligence (AI) and high-performance computing (HPC) that cater to developers, data scientists, and IT administrators. NVIDIA generates revenue through the sale of hardware, software solutions, and cloud-based services, such as NVIDIA CloudXR and NGC, which enhance experiences in AI, machine learning, and computer vision. What sets NVIDIA apart from competitors is its strong focus on research and development, allowing it to maintain a leadership position in a competitive market. The company's goal is to drive innovation and provide advanced solutions that meet the needs of a diverse clientele, including gamers, researchers, and enterprises.

Santa Clara, CaliforniaHeadquarters
1993Year Founded
$19.5MTotal Funding
IPOCompany Stage
Automotive & Transportation, Enterprise Software, AI & Machine Learning, GamingIndustries
10,001+Employees

Benefits

Company Equity
401(k) Company Match

Risks

Increased competition from AI startups like xAI could challenge NVIDIA's market position.
Serve Robotics' expansion may divert resources from NVIDIA's core GPU and AI businesses.
Integration of VinBrain may pose challenges and distract from NVIDIA's primary operations.

Differentiation

NVIDIA leads in AI and HPC solutions with cutting-edge GPU technology.
The company excels in diverse markets, including gaming, data centers, and autonomous vehicles.
NVIDIA's cloud services, like CloudXR, offer scalable solutions for AI and machine learning.

Upsides

Acquisition of VinBrain enhances NVIDIA's AI capabilities in the healthcare sector.
Investment in Nebius Group boosts NVIDIA's AI infrastructure and cloud platform offerings.
Serve Robotics' expansion, backed by NVIDIA, highlights growth in autonomous delivery services.

Land your dream remote job 3x faster with AI