NVIDIA

Senior Solutions Architect - AI Infrastructure Engineer

Massachusetts, United States

Not SpecifiedCompensation
Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
Information Technology, Research & DevelopmentIndustries

Solutions Architect - Higher Education and Research

Employment Type: Full-time

Position Overview

Are you an experienced systems architect with an interest in advancing artificial intelligence (AI) and high-performance computing (HPC) in academic and research environments? We are looking for a Solutions Architect to join the higher education and research team! In this role, you will work with universities and research institutions to optimize the design and deployment of AI infrastructure. Our team applies expertise in accelerated software and hardware systems to help enable groundbreaking advancements in AI, deep learning, and scientific research. This role requires a strong background in building and deploying research computing clusters, deploying AI and HPC workloads, and optimizing system performance at scale.

Responsibilities

  • Collaborate as a key technical advisor for the design, build-out, and optimization of university-level research computing infrastructures powering GPU-accelerated scientific workflows.
  • Work with university research computing to optimize hardware utilization with software orchestration tools such as NVIDIA Base Command, Kubernetes, Slurm, and Jupyter notebook environments.
  • Implement systems monitoring and management tools to help optimize resource utilization and gain insight into the most demanding application workloads at research computing centers.
  • Document learnings through targeted training, whitepapers, blogs, and wiki articles, and collaborate with researchers on problem-solving.
  • Collaborate with researchers to gather feature requests and product feedback for product and engineering teams.

Requirements

  • BS/MS/PhD in Engineering, Mathematics, Physical Sciences, or Computer Science (or equivalent experience).
  • 8+ years of relevant work experience.
  • Strong experience in designing and deploying GPU-accelerated computing infrastructure.
  • In-depth knowledge of cluster orchestration and job scheduling technologies, e.g., Slurm, Kubernetes, Ansible, and/or Open OnDemand.
  • Experience with container tools (Docker, Singularity) including at-scale deployment of containerized environments.
  • Expertise in systems monitoring, telemetry, and systems performance optimization of research computing environments. Familiarity with tools such as Prometheus, Grafana, and NVIDIA DCGM.
  • Understanding of datacenter networking technologies (InfiniBand, Ethernet, OFED) and experience with network configuration.
  • Familiarity with power and cooling systems architecture for data center infrastructure.

Ways to Stand Out

  • Background in deploying LLM training and inference workflows in a research computing environment.
  • Experience deploying and evaluating cluster performance using benchmarks such as MLPerf and/or HPL.
  • Experience in delivering technical training, workshops, or mentoring researchers on using HPC/AI systems.
  • Applications and systems-level knowledge of OpenMPI and NCCL.
  • Experience with debugging and profiling tools (e.g., Nsight Systems, Nsight Compute, Compute Sanitizer, GDB, or Valgrind).

Compensation and Benefits

  • Salary Range: $184,000 - $287,500 USD (base salary determined by location, experience, and pay equity).
  • Eligible for equity and benefits.

Company Information

NVIDIA accepts applications on an ongoing basis. NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law.

Skills

GPU-accelerated computing
High-performance computing (HPC)
Research computing clusters
Kubernetes
Slurm
Jupyter notebooks
System monitoring and management
Hardware utilization optimization
Software orchestration

NVIDIA

Designs GPUs and AI computing solutions

About NVIDIA

NVIDIA designs and manufactures graphics processing units (GPUs) and system on a chip units (SoCs) for various markets, including gaming, professional visualization, data centers, and automotive. Their products include GPUs tailored for gaming and professional use, as well as platforms for artificial intelligence (AI) and high-performance computing (HPC) that cater to developers, data scientists, and IT administrators. NVIDIA generates revenue through the sale of hardware, software solutions, and cloud-based services, such as NVIDIA CloudXR and NGC, which enhance experiences in AI, machine learning, and computer vision. What sets NVIDIA apart from competitors is its strong focus on research and development, allowing it to maintain a leadership position in a competitive market. The company's goal is to drive innovation and provide advanced solutions that meet the needs of a diverse clientele, including gamers, researchers, and enterprises.

Santa Clara, CaliforniaHeadquarters
1993Year Founded
$19.5MTotal Funding
IPOCompany Stage
Automotive & Transportation, Enterprise Software, AI & Machine Learning, GamingIndustries
10,001+Employees

Benefits

Company Equity
401(k) Company Match

Risks

Increased competition from AI startups like xAI could challenge NVIDIA's market position.
Serve Robotics' expansion may divert resources from NVIDIA's core GPU and AI businesses.
Integration of VinBrain may pose challenges and distract from NVIDIA's primary operations.

Differentiation

NVIDIA leads in AI and HPC solutions with cutting-edge GPU technology.
The company excels in diverse markets, including gaming, data centers, and autonomous vehicles.
NVIDIA's cloud services, like CloudXR, offer scalable solutions for AI and machine learning.

Upsides

Acquisition of VinBrain enhances NVIDIA's AI capabilities in the healthcare sector.
Investment in Nebius Group boosts NVIDIA's AI infrastructure and cloud platform offerings.
Serve Robotics' expansion, backed by NVIDIA, highlights growth in autonomous delivery services.

Land your dream remote job 3x faster with AI