Senior Software Engineer, AI Agent Platform at NVIDIA

Tel Aviv-Yafo, TA, Israel

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

Artificial Intelligence, Technology, NetworkingIndustries

Requirements

BSc or above in Computer Science, Computer Engineering, or a related field, or equivalent experience
7+ years of hands-on experience in software engineering, with a focus on backend systems, cloud services, or infrastructure
Proven experience with AI/ML frameworks (e.g., PyTorch, TensorFlow) and a strong understanding of large language models (LLMs), transformers, and agent-based architectures (e.g., LangChain, LlamaIndex)
Demonstrated experience in architecting, building and deploying complex integrations between AI agents and external tools, APIs, or software services
Expert-level programming skills in Python. Experience with C++ is a strong plus
Experience designing, building, and maintaining RESTful APIs, gRPC, and other service-to-service communication protocols
Excellent problem-solving skills and the ability to navigate complex, ambiguous technical challenges
Strong communication and interpersonal skills, with a proven ability to collaborate effectively across multidisciplinary teams

Responsibilities

Architect and build robust, scalable frameworks and APIs to integrate AI agents with Nvidia's suite of developer tools, simulation platforms, and enterprise software
Collaborate with research, applied AI, and product teams to understand agent capabilities and translate them into production-ready services and features
Design and implement CI/CD pipelines and MLOps practices tailored for the AI agent lifecycle, including testing, deployment, monitoring, and continuous improvement
Optimize the performance, latency, and resource consumption of deployed AI agents, ensuring they operate efficiently within our compute infrastructure
Develop internal tooling and automation to streamline the onboarding of new AI agents and enhance the observability of agent fleets
Champion best practices for secure and reliable agent-based systems, including data handling, access control, and interaction protocols
Serve as a key technical resource for solving sophisticated integration issues between AI agents and target applications

Skills

Key technologies and capabilities for this role

AI AgentsAPIsScalable FrameworksCI/CDMLOpsObservabilityPerformance OptimizationAutomationData HandlingAccess Control

Questions & Answers

Common questions about this position

What experience level is required for this Senior Software Engineer role?

The role requires 7+ years of hands-on experience in software engineering, with a focus on backend systems, cloud services, or infrastructure.

What key technical skills are needed for this position?

Candidates need expert-level Python programming skills, experience with AI/ML frameworks like PyTorch and TensorFlow, understanding of LLMs and agent architectures like LangChain, and skills in designing RESTful APIs and gRPC.

What education is required for this job?

A BSc or above in Computer Science, Computer Engineering, or a related field, or equivalent experience is required.

Is this a remote position or does it require office work?

This information is not specified in the job description.

What salary or compensation does this role offer?

This information is not specified in the job description.

What soft skills are important for this role?

Excellent problem-solving skills, ability to navigate complex challenges, strong communication, and interpersonal skills for collaborating across multidisciplinary teams are required.

How can I stand out as a candidate for this position?

Stand out with hands-on experience building or fine-tuning LLMs or generative models, and prior experience with MLOps and agentic infrastructure.

NVIDIA

Designs GPUs and AI computing solutions

About NVIDIA

NVIDIA designs and manufactures graphics processing units (GPUs) and system on a chip units (SoCs) for various markets, including gaming, professional visualization, data centers, and automotive. Their products include GPUs tailored for gaming and professional use, as well as platforms for artificial intelligence (AI) and high-performance computing (HPC) that cater to developers, data scientists, and IT administrators. NVIDIA generates revenue through the sale of hardware, software solutions, and cloud-based services, such as NVIDIA CloudXR and NGC, which enhance experiences in AI, machine learning, and computer vision. What sets NVIDIA apart from competitors is its strong focus on research and development, allowing it to maintain a leadership position in a competitive market. The company's goal is to drive innovation and provide advanced solutions that meet the needs of a diverse clientele, including gamers, researchers, and enterprises.

Santa Clara, CaliforniaHeadquarters

1993Year Founded

$19.5MTotal Funding

IPOCompany Stage

Automotive & Transportation, Enterprise Software, AI & Machine Learning, GamingIndustries

10,001+Employees

Benefits

Company Equity

401(k) Company Match

Risks

Increased competition from AI startups like xAI could challenge NVIDIA's market position.

Serve Robotics' expansion may divert resources from NVIDIA's core GPU and AI businesses.

Integration of VinBrain may pose challenges and distract from NVIDIA's primary operations.

Differentiation

NVIDIA leads in AI and HPC solutions with cutting-edge GPU technology.

The company excels in diverse markets, including gaming, data centers, and autonomous vehicles.

NVIDIA's cloud services, like CloudXR, offer scalable solutions for AI and machine learning.

Upsides

Acquisition of VinBrain enhances NVIDIA's AI capabilities in the healthcare sector.

Investment in Nebius Group boosts NVIDIA's AI infrastructure and cloud platform offerings.

Serve Robotics' expansion, backed by NVIDIA, highlights growth in autonomous delivery services.

Land your dream remote job 3x faster with AI

Try Jobo Free