Senior Software Engineer - Computer Vision and VLM Deep Learning at NVIDIA

Santa Clara, California, United States

NVIDIA Logo
Not SpecifiedCompensation
Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
Robotics, Artificial Intelligence, TechnologyIndustries

Requirements

  • Masters in Computer Science, Robotics, Deep Learning, or other related fields (or equivalent experience)
  • 8+ years of algorithm development/research experience and relevant work/research experience in one or many of the following areas: Geometric computer vision models, semantic understanding models, vision-language models, foundation models, 3D-LLMs, video generative models, or diffusion algorithms
  • Hands-on experience with deep learning frameworks (e.g., TensorFlow, PyTorch) and proficiency in modern software development practices (version control, testing, CI/CD)
  • Excellent communication skills and the ability to collaborate efficiently in a cross-functional, distributed team environment
  • Proficient in C++ and Python
  • Thirst and ability to learn and adapt to new technologies

Responsibilities

  • Conduct applied research and design innovative algorithms in the space of geometric computer vision and video/vision-language models
  • Deploy algorithms on real humanoid robots to gauge sim-to-real transfer of models
  • Work hand-in-hand across multiple engineering and research teams to enable foundation models on humanoid robots
  • Constantly learn and explore unfamiliar technologies

Skills

Key technologies and capabilities for this role

PyTorchTensorFlowC++PythonComputer VisionVision-Language ModelsDeep LearningFoundation ModelsDiffusion ModelsCI/CD

Questions & Answers

Common questions about this position

What is the salary range for this Senior Software Engineer position?

The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5, determined based on location, experience, and pay of employees in similar positions. Candidates are also eligible for equity and benefits.

Is this a remote position, or is there an office requirement?

This information is not specified in the job description.

What skills and experience are required for this role?

Required qualifications include a Masters in Computer Science, Robotics, Deep Learning or related fields (or equivalent), 8+ years of algorithm development/research in areas like geometric computer vision, vision-language models, or diffusion algorithms, hands-on experience with deep learning frameworks like PyTorch or TensorFlow, proficiency in C++ and Python, and excellent communication skills for cross-functional teams.

What is the company culture like at NVIDIA for this team?

NVIDIA has some of the most forward-thinking and hardworking people, fostering a collaborative, cross-functional, distributed team environment where employees constantly learn, explore new technologies, and push the boundaries of robotics and AI.

What makes a candidate stand out for this position?

Candidates stand out with a Ph.D. in a related field, publications in top-tier AI conferences, contributions to open-source projects, hands-on experience with real-world robotic systems, and experience with vision-language-action models.

NVIDIA

Designs GPUs and AI computing solutions

About NVIDIA

NVIDIA designs and manufactures graphics processing units (GPUs) and system on a chip units (SoCs) for various markets, including gaming, professional visualization, data centers, and automotive. Their products include GPUs tailored for gaming and professional use, as well as platforms for artificial intelligence (AI) and high-performance computing (HPC) that cater to developers, data scientists, and IT administrators. NVIDIA generates revenue through the sale of hardware, software solutions, and cloud-based services, such as NVIDIA CloudXR and NGC, which enhance experiences in AI, machine learning, and computer vision. What sets NVIDIA apart from competitors is its strong focus on research and development, allowing it to maintain a leadership position in a competitive market. The company's goal is to drive innovation and provide advanced solutions that meet the needs of a diverse clientele, including gamers, researchers, and enterprises.

Santa Clara, CaliforniaHeadquarters
1993Year Founded
$19.5MTotal Funding
IPOCompany Stage
Automotive & Transportation, Enterprise Software, AI & Machine Learning, GamingIndustries
10,001+Employees

Benefits

Company Equity
401(k) Company Match

Risks

Increased competition from AI startups like xAI could challenge NVIDIA's market position.
Serve Robotics' expansion may divert resources from NVIDIA's core GPU and AI businesses.
Integration of VinBrain may pose challenges and distract from NVIDIA's primary operations.

Differentiation

NVIDIA leads in AI and HPC solutions with cutting-edge GPU technology.
The company excels in diverse markets, including gaming, data centers, and autonomous vehicles.
NVIDIA's cloud services, like CloudXR, offer scalable solutions for AI and machine learning.

Upsides

Acquisition of VinBrain enhances NVIDIA's AI capabilities in the healthcare sector.
Investment in Nebius Group boosts NVIDIA's AI infrastructure and cloud platform offerings.
Serve Robotics' expansion, backed by NVIDIA, highlights growth in autonomous delivery services.

Land your dream remote job 3x faster with AI