Senior System Software Engineer, NCCL - Partner Enablement

Position Overview

• Location Type:
• Job Type: Full time
• Salary:

NVIDIA is a leader in Artificial Intelligence, High Performance Computing, and Visualization. Our invention, the GPU, is central to modern computing and powers groundbreaking innovations from AI to autonomous vehicles. We are seeking a motivated Partner Enablement Engineer to guide key partners and customers in utilizing NCCL, a crucial GPU communication library for scaling Deep Learning and HPC applications. This role offers an end-to-end understanding of the AI networking stack, working with high-speed networking technologies like Infiniband, RoCE, and Ethernet.

Responsibilities

• Engage with partners and customers to diagnose and resolve functional and performance issues with NCCL.
• Conduct performance characterization and analysis of NCCL and Deep Learning applications on advanced GPU clusters.
• Develop tools and automation to isolate issues across new systems and platforms, including cloud environments (Azure, AWS, GCP).
• Provide guidance to customers and support teams on HPC best practices for multi-node cluster applications.
• Document and deliver training sessions and webinars on NCCL.
• Collaborate with internal teams across different time zones on networking, GPUs, storage, infrastructure, and support.

Requirements

• B.S./M.S. degree in Computer Science/Computer Engineering or equivalent experience with 5+ years of relevant experience.
• Experience with parallel programming and at least one communication runtime (MPI, NCCL, UCX, NVSHMEM).
• Excellent C/C++ programming skills, including debugging, profiling, code optimization, performance analysis, and test design.
• Experience working with the engineering or academic research community supporting HPC or AI.
• Practical experience with high-performance networking: Infiniband/RoCE/Ethernet networks, RDMA, topologies, and congestion control.
• Expertise in Linux fundamentals and a scripting language, preferably Python.
• Familiarity with containers, cloud provisioning, and scheduling tools (Docker, Docker Swarm, Kubernetes, SLURM, Ansible).
• Adaptability and a passion for learning new areas and tools.
• Flexibility to work and communicate effectively across different teams and time zones.

Ways to Stand Out

• Experience conducting performance benchmarking and developing infrastructure on HPC clusters.
• Prior system administration experience, especially for large clusters.
• Experience debugging network configuration issues in large-scale deployments.
• Familiarity with CUDA programming and/or GPUs.
• Good understanding of Machine Learning concepts and experience with Deep Learning Frameworks like PyTorch, TensorFlow.
• Deep understanding of technology and a passion for your work.

Company Information

NVIDIA is at the forefront of breakthroughs in Artificial Intelligence, High-Performance Computing, and Visualization. Our teams are composed of driven, innovative professionals dedicated to pushing the boundaries of technology. We offer highly competitive salaries, an extensive benefits package, and a work environment that promotes diversity, inclusion, and flexibility. As an equal opportunity employer, we are committed to fostering a supportive and empowering workplace for all.