Senior Research Engineer - Enterprise Products

Position Overview

• Location Type: [Not Specified]
• Job Type: Full time
• Salary: $184,000 - $356,500 USD (Base salary determined by location, experience, and pay equity. Eligibility for equity and benefits.)

NVIDIA is seeking a Senior Research Engineer with a passion for Generative AI inference. This role involves contributing to the entire machine learning lifecycle, from conceptualization and applied research to engineering optimized inference and deployment. The team focuses on developing cutting-edge technologies to support NVIDIA's generative AI initiatives, making AI development, integration, and deployment more accessible.

Responsibilities

• Developing new models and algorithms for Large Language Models (LLMs), Natural Language Processing (NLP), and Deep Learning.
• Designing and implementing multi-node serving architectures, including disaggregated serving and distributed LLM inference.
• Optimizing multi-LoRA (and other Parameter-Efficient Fine-Tuning techniques) inference serving systems.
• Applying advanced quantization techniques (FP4/INT4, FP8) to reduce model footprint while maintaining quality.
• Implementing speculative decoding (e.g., draft-and-accept, eagle, Medusa) and other latency optimization strategies.
• Adhering to strong engineering practices and mentoring other team members.
• Collaborating with engineering teams across NVIDIA to ensure seamless software integration within the NVIDIA accelerated serving stack.

Requirements

• Understanding of modern techniques in Machine Learning, Deep Neural Networks, Natural Language Processing, or Speech Recognition.
• 8+ years of industry experience with Deep Learning frameworks (PyTorch or TensorFlow).
• Strong passion for software engineering, with excellent C++ and Python development skills.
• Meaningful contributions to major open-source projects.
• Strong communication and interpersonal skills, with the ability to thrive in a dynamic and distributed team environment.
• A history of mentoring junior engineers and interns is a significant advantage.
• Bachelor's degree or equivalent experience.
• A strong desire for continuous learning and growth.
• Solid computer science fundamentals, including algorithms, data structures, computational complexity, parallel and distributed computing, and system software.

Ways to Stand Out

• Experience architecting or developing large-scale distributed systems for deep learning.
• Knowledge of CPU and/or GPU architecture.
• Experience with GPU programming (CUDA).

Company Information

NVIDIA accepts applications on an ongoing basis. NVIDIA is committed to fostering a diverse work environment and is proud to be an equal opportunity employer. NVIDIA values diversity and does not discriminate based on race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law in its hiring and promotion practices.