AI Software Engineer at Zoom

Seattle, Washington, United States

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

TechnologyIndustries

Requirements

Track record of building scalable, reliable AI infrastructure under real-world production constraints
Strong expertise in GPU programming and optimization (CUDA, kernel-level development)
Deep experience with transformer-based models and inference frameworks (vLLM, TensorRT-LLM, SGLang, ONNX Runtime)
Proficiency in Python and C++ (Java is a plus)
Hands-on experience with PyTorch (TorchCompile, graph-level optimization) and/or TensorFlow
Knowledge of low-level hardware concepts (GPU memory hierarchy, caching, vectorization)
Familiarity with cloud platforms (AWS, GCP, Azure) and AI deployment tools (Docker, Kubernetes, MLflow)

Responsibilities

Develop and optimize AI runtimes for LLMs, ASR, and MT systems with a focus on performance and cost efficiency
Apply GPU-level optimization techniques including CUDA, kernel fusion, and memory throughput improvements
Implement inference optimizations such as TorchCompile, graph optimization, KV cache, and continuous batching
Build scalable, highly available infrastructure services to support enterprise-grade AI workloads
Optimize models for edge devices (laptops, PCs and mobile devices) as well as large-scale cloud deployments
Continuously improve latency, throughput, and efficiency across serving pipelines
Rapidly integrate and optimize new industry models to stay ahead in AI infrastructure

Skills

Key technologies and capabilities for this role

CUDATorchCompilevLLMTensorRT-LLMSGLangONNX RuntimeKV cachecontinuous batchingkernel fusiongraph optimizationLLMsASRtransformer-based models

Questions & Answers

Common questions about this position

What is the salary range for the AI Software Engineer position?

The salary range is a minimum of $143,000 and a maximum of $312,800. Starting pay depends on factors like qualifications, experience, and location.

Is this AI Software Engineer role remote or office-based?

This information is not specified in the job description.

What key skills are required for the AI Software Engineer role?

Required skills include strong expertise in GPU programming and optimization (CUDA), deep experience with transformer-based models and inference frameworks (vLLM, TensorRT-LLM, SGLang, ONNX Runtime), proficiency in Python and C++, and hands-on experience with PyTorch or TensorFlow.

What is the team like for this AI Software Engineer position?

The AI Infra team at Zoom builds a world-class inference infrastructure powering Zoom’s AI services, focusing on high efficiency, scalability, and cost optimization for AI applications like LLMs, VLMs, ASR, and machine translation.

What makes a strong candidate for the AI Software Engineer role?

A strong candidate has a track record of building scalable, reliable AI infrastructure in production, expertise in GPU optimization and transformer models, and hands-on experience with PyTorch, inference frameworks, and cloud platforms.

Zoom

Video conferencing and online meeting solutions

About Zoom

Zoom provides video conferencing and online meeting solutions that allow users to conduct virtual meetings, webinars, and collaborative sessions. Its main product is video conferencing software, which enables high-quality video and audio communication, along with features like screen sharing, group messaging, and virtual backgrounds. Zoom also offers specialized products for larger events, such as Zoom Webinars and Zoom Events. The company operates on a freemium model, providing basic services for free while charging for advanced features through subscription plans tailored for various users, including businesses, educational institutions, and healthcare providers. Zoom stands out from competitors due to its user-friendly interface, reliable performance, and scalability for different needs, making it a vital tool for remote work, online education, telehealth, and social interactions.

San Jose, CaliforniaHeadquarters

2013Year Founded

$144.5MTotal Funding

IPOCompany Stage

Enterprise Software, Education, HealthcareIndustries

10,001+Employees

Benefits

Health Insurance

Dental Insurance

Vision Insurance

Life Insurance

Disability Insurance

Hybrid Work Options

Flexible Work Hours

Stock Options

Company Equity

Paid Vacation

Paid Sick Leave

Risks

Increased competition from Microsoft Teams and Google Meet threatens Zoom's market share.

Privacy concerns and regulatory scrutiny could impact Zoom's operations and reputation.

Hybrid work models may reduce demand for virtual meetings, affecting Zoom's growth.

Differentiation

Zoom offers a user-friendly interface with reliable performance for virtual meetings.

The platform supports diverse needs, including remote work, education, and telehealth.

Zoom's freemium model attracts a wide range of users with scalable subscription options.

Upsides

Zoom integrates AI tools to enhance virtual meeting effectiveness and productivity.

The expansion of 5G networks improves Zoom's video conferencing quality and accessibility.

Zoom's secure, HIPAA-compliant solutions drive demand in the telehealth sector.

Land your dream remote job 3x faster with AI

Try Jobo Free