Senior Systems Engineer – High-Performance AI and Networking Applications at NVIDIA

Santa Clara, California, United States

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

AI, High-Performance Computing, NetworkingIndustries

Requirements

BS/MS or PhD in Computer Science, Engineering, or related field, or equivalent experience
8+ years of proven experience in AI/HPC Infrastructure
Familiarity with AI/HPC job schedulers and orchestrators like Slurm, K8s, or LSF
Practical exposure to AI/HPC workflows employing MPI and NCCL
Familiarity with High-Speed Networking pertaining to HPC including InfiniBand, RDMA, RoCE, and Amazon EFA
Essential understanding of PyTorch, MegatronLM, and Deep Learning Inference frameworks such as vllm/sglang
Proven experience with InfiniBand, NVLINK, and high-speed networking technologies in HPC or large-scale datacenter environments
Experience investigating and evaluating performance in multi-node systems, especially in deep learning or scientific computing tasks
Strong analytical, debugging, and technical communication skills
Comfortable working in collaborative, multi-faceted teams

Responsibilities

Collaborate with networking teams to plan, implement, and evaluate performance benchmarks on NVLINK, NVSwitch, and InfiniBand powered infrastructures
Assess findings and work closely with framework, hardware, and support teams to improve system performance across various deep learning workloads
Act as a primary resource for fixing networking and hardware integration issues, focusing on scalable multi-node systems
Maintain high communication standards across multiple engineering, support, and R&D teams, ensuring technical and performance goals are met
Offer technical mentorship and documentation for internal teams and external partners on standard methodologies in HPC networking deployments
Share insights on improving networking strategies for substantial AI and deep learning infrastructure

Skills

NVLINK

NVSwitch

InfiniBand

Slurm

Kubernetes

LSF

MPI

NCCL

RDMA

RoCE

Amazon EFA

PyTorch

MegatronLM

vllm

sglang

HPC

NVIDIA

Designs GPUs and AI computing solutions

About NVIDIA

NVIDIA designs and manufactures graphics processing units (GPUs) and system on a chip units (SoCs) for various markets, including gaming, professional visualization, data centers, and automotive. Their products include GPUs tailored for gaming and professional use, as well as platforms for artificial intelligence (AI) and high-performance computing (HPC) that cater to developers, data scientists, and IT administrators. NVIDIA generates revenue through the sale of hardware, software solutions, and cloud-based services, such as NVIDIA CloudXR and NGC, which enhance experiences in AI, machine learning, and computer vision. What sets NVIDIA apart from competitors is its strong focus on research and development, allowing it to maintain a leadership position in a competitive market. The company's goal is to drive innovation and provide advanced solutions that meet the needs of a diverse clientele, including gamers, researchers, and enterprises.

Santa Clara, CaliforniaHeadquarters

1993Year Founded

$19.5MTotal Funding

IPOCompany Stage

Automotive & Transportation, Enterprise Software, AI & Machine Learning, GamingIndustries

10,001+Employees

Benefits

Company Equity

401(k) Company Match

Risks

Increased competition from AI startups like xAI could challenge NVIDIA's market position.

Serve Robotics' expansion may divert resources from NVIDIA's core GPU and AI businesses.

Integration of VinBrain may pose challenges and distract from NVIDIA's primary operations.

Differentiation

NVIDIA leads in AI and HPC solutions with cutting-edge GPU technology.

The company excels in diverse markets, including gaming, data centers, and autonomous vehicles.

NVIDIA's cloud services, like CloudXR, offer scalable solutions for AI and machine learning.

Upsides

Acquisition of VinBrain enhances NVIDIA's AI capabilities in the healthcare sector.

Investment in Nebius Group boosts NVIDIA's AI infrastructure and cloud platform offerings.

Serve Robotics' expansion, backed by NVIDIA, highlights growth in autonomous delivery services.

Land your dream remote job 3x faster with AI

Try Jobo Free