Job Description

Position Overview

• Location Type: [Not Specified]
• Employment Type: Full-time
• Salary: $184,000 - $356,500 USD (Base Salary Range)

NVIDIA is seeking outstanding engineers to join their team and shape the future of LLM inference. The team focuses on improving the algorithmic performance and efficiency of LLM systems, developing new inference algorithms, improving existing models, and ensuring NVIDIA’s solutions can efficiently handle large-scale, sophisticated tasks.

Requirements

• Education: BS, MS, or PhD in Computer Science, Electrical Engineering, Computer Engineering, or a related field (or equivalent experience).
• Experience: 8+ years of experience in deep learning and deep learning systems design.
• Programming Skills: Proficiency in Python and C++ programming.
• Technical Knowledge: Strong understanding of computer architecture, GPU/parallel datacenter computing fundamentals.
• Interest: Proven interest in analyzing, modeling, and tuning application performance.

Responsibilities

• Research and Development: Explore and incorporate contemporary research on generative AI, agents, and inference systems into the NVIDIA LLM software stack.
• Workload Analysis and Optimization: Conduct in-depth analysis, profiling, and optimization of agentic LLM workloads to reduce request latency and increase request throughput while maintaining workflow fidelity.
• System Design and Implementation: Design and implement scalable systems to accelerate agentic workflows and efficiently handle sophisticated datacenter-scale use cases.
• Collaboration and Communication: Advise future iterations of NVIDIA software, hardware, and system by engaging with diverse teams at NVIDIA and external partners, formalizing strategic requirements.

Application Instructions

• [Not Specified - Please refer to NVIDIA's career website for application instructions.]

Company Information

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. They are at the forefront of large language models and AI, defining the next era of computing with GPUs acting as the brains of computers, robots, and self-driving cars. The base salary range is $184,000 - $356,500 USD, determined by location, experience, and the pay of similar employees.