Senior Software Engineer - Parallel Computing Systems at NVIDIA

Santa Clara, California, United States

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

Artificial Intelligence, High-Performance Computing, SemiconductorsIndustries

Requirements

MS or PhD in Computer Science, Computer Engineering, Electrical Engineering, or related field (or equivalent experience)
4+ years advanced C++ programming with large codebase development, template meta-programming, and performance-critical code
Strong parallel programming experience with multi-threading, OpenMP, CUDA, MPI, NCCL, NVSHMEM, or other parallel computing technologies
Shown experience with low-level performance optimization and systematic bottleneck identification beyond basic profiling
Performance analysis skills: experience analyzing high-level programs to identify performance bottlenecks and develop optimization strategies
Collaborative problem-solving approach with adaptability in ambiguous situations, first-principles based thinking, and a sense of ownership
Excellent verbal and written communication skills

Responsibilities

Design algorithms that generate highly optimized code from deep learning programs
Build GPU-aware CPU runtime systems that coordinate kernel execution for maximum performance
Work directly with NVIDIA's hardware engineers to master the latest GPU architectures
Collaborate with optimization specialists to develop innovative techniques for emerging AI workloads
Debug performance bottlenecks in thousand-GPU distributed systems
Influence next-generation hardware design

Skills

CUDA

C++

PyTorch

Compiler Infrastructure

Kernel Optimization

Systems Programming

Parallel Programming

GPU Programming

High-Performance Computing

Deep Learning

NVIDIA

Designs GPUs and AI computing solutions

About NVIDIA

NVIDIA designs and manufactures graphics processing units (GPUs) and system on a chip units (SoCs) for various markets, including gaming, professional visualization, data centers, and automotive. Their products include GPUs tailored for gaming and professional use, as well as platforms for artificial intelligence (AI) and high-performance computing (HPC) that cater to developers, data scientists, and IT administrators. NVIDIA generates revenue through the sale of hardware, software solutions, and cloud-based services, such as NVIDIA CloudXR and NGC, which enhance experiences in AI, machine learning, and computer vision. What sets NVIDIA apart from competitors is its strong focus on research and development, allowing it to maintain a leadership position in a competitive market. The company's goal is to drive innovation and provide advanced solutions that meet the needs of a diverse clientele, including gamers, researchers, and enterprises.

Santa Clara, CaliforniaHeadquarters

1993Year Founded

$19.5MTotal Funding

IPOCompany Stage

Automotive & Transportation, Enterprise Software, AI & Machine Learning, GamingIndustries

10,001+Employees

Benefits

Company Equity

401(k) Company Match

Risks

Increased competition from AI startups like xAI could challenge NVIDIA's market position.

Serve Robotics' expansion may divert resources from NVIDIA's core GPU and AI businesses.

Integration of VinBrain may pose challenges and distract from NVIDIA's primary operations.

Differentiation

NVIDIA leads in AI and HPC solutions with cutting-edge GPU technology.

The company excels in diverse markets, including gaming, data centers, and autonomous vehicles.

NVIDIA's cloud services, like CloudXR, offer scalable solutions for AI and machine learning.

Upsides

Acquisition of VinBrain enhances NVIDIA's AI capabilities in the healthcare sector.

Investment in Nebius Group boosts NVIDIA's AI infrastructure and cloud platform offerings.

Serve Robotics' expansion, backed by NVIDIA, highlights growth in autonomous delivery services.

Land your dream remote job 3x faster with AI

Try Jobo Free