Senior LLM Agents Architect at NVIDIA

Tel Aviv-Yafo, TA, Israel

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level

Full TimeJob Type

UnknownVisa

Technology, AI, SemiconductorIndustries

Requirements

7+ years in applied ML/AI or large-scale systems, with 3+ years crafting agentic or LLM-powered applications in production environments
B.Sc in Computer Science/Electrical Engineering
Proven ownership of at least one end-to-end agentic system or LLM application: requirements, architecture, implementation, evaluation, and incremental hardening in production
Strong software engineering skills in Python and one systems language (C++ or Rust preferred); experience integrating with GPUs, CUDA, or performance-critical services
Proficient in PyTorch or TensorFlow; skilled in tool use, RAG pipelines, and model adaptation
Demonstrated ability to collaborate with HW/SW domain experts and translate their heuristics into deterministic tools, constraints, and evaluation metrics
Excellence in communication and facilitation: aligning diverse collaborators, documenting decisions/assumptions, and influencing without authority
Track record of building observability for AI systems: dataset/version management, offline test suites, online telemetry, guardrails/safety checks, and rollback plans
Proactive, independent, possessing strong analytical and problem-solving abilities; adept at handling uncertainty to provide practical, gradual benefits

Responsibilities

Develop innovative AI flows to improve hardware and software through collaboration with various engineering roles
Facilitate co-creation workshops to transform SME rules of thumb into specific assignments, resources, cues, and guidelines
Define success measures, evaluation data, and feedback loops for agents to make a measurable difference in NVIDIA's HW simulation analysis and GPU-kernel optimization workflows
Rapidly prototype and thoughtfully productize; integrate with internal services, utilize GPU capabilities, remove bottlenecks, and deliver fitting solutions
Set up evaluation backbone using offline golden sets and online telemetry for confident iterations, cost control, and safe improvements
Mentor and improve teams through insights in agent orchestration, prompting, RAG, observability, crafting documentation and playbooks for NVIDIA's teams

Skills

Key technologies and capabilities for this role

LLMAI AgentsPythonC++RustCUDAGPURAGPromptingAgent OrchestrationMachine LearningSoftware EngineeringProduction Systems

Questions & Answers

Common questions about this position

What experience level is required for the Senior LLM Agents Architect role?

The role requires 7+ years in applied ML/AI or large-scale systems, with 3+ years crafting agentic or LLM-powered applications in production environments, plus proven ownership of at least one end-to-end agentic system.

What technical skills are needed for this position?

Candidates need strong software engineering skills in Python and one systems language like C++ or Rust, proficiency in PyTorch or TensorFlow, experience with GPUs/CUDA, tool use, RAG pipelines, and model adaptation.

What is the compensation like at NVIDIA for this role?

NVIDIA offers highly competitive salaries and a comprehensive benefits package; visit www.nvidiabenefits.com/ for details on what is offered to you and your family.

What education is required for this job?

A B.Sc in Computer Science or Electrical Engineering is required.

What soft skills or qualities make a strong candidate for this role?

Strong communication and facilitation skills for aligning diverse collaborators, excellence in documenting decisions, influencing without authority, proactivity, independence, and strong analytical/problem-solving abilities are key.

NVIDIA

Designs GPUs and AI computing solutions

About NVIDIA

NVIDIA designs and manufactures graphics processing units (GPUs) and system on a chip units (SoCs) for various markets, including gaming, professional visualization, data centers, and automotive. Their products include GPUs tailored for gaming and professional use, as well as platforms for artificial intelligence (AI) and high-performance computing (HPC) that cater to developers, data scientists, and IT administrators. NVIDIA generates revenue through the sale of hardware, software solutions, and cloud-based services, such as NVIDIA CloudXR and NGC, which enhance experiences in AI, machine learning, and computer vision. What sets NVIDIA apart from competitors is its strong focus on research and development, allowing it to maintain a leadership position in a competitive market. The company's goal is to drive innovation and provide advanced solutions that meet the needs of a diverse clientele, including gamers, researchers, and enterprises.

Santa Clara, CaliforniaHeadquarters

1993Year Founded

$19.5MTotal Funding

IPOCompany Stage

Automotive & Transportation, Enterprise Software, AI & Machine Learning, GamingIndustries

10,001+Employees

Benefits

Company Equity

401(k) Company Match

Risks

Increased competition from AI startups like xAI could challenge NVIDIA's market position.

Serve Robotics' expansion may divert resources from NVIDIA's core GPU and AI businesses.

Integration of VinBrain may pose challenges and distract from NVIDIA's primary operations.

Differentiation

NVIDIA leads in AI and HPC solutions with cutting-edge GPU technology.

The company excels in diverse markets, including gaming, data centers, and autonomous vehicles.

NVIDIA's cloud services, like CloudXR, offer scalable solutions for AI and machine learning.

Upsides

Acquisition of VinBrain enhances NVIDIA's AI capabilities in the healthcare sector.

Investment in Nebius Group boosts NVIDIA's AI infrastructure and cloud platform offerings.

Serve Robotics' expansion, backed by NVIDIA, highlights growth in autonomous delivery services.

Land your dream remote job 3x faster with AI

Try Jobo Free