AI Software Engineer at Zoom

Seattle, Washington, United States

Zoom Logo
Not SpecifiedCompensation
Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
TechnologyIndustries

Requirements

  • Track record of building scalable, reliable AI infrastructure under real-world production constraints
  • Strong expertise in GPU programming and optimization (CUDA, kernel-level development)
  • Deep experience with transformer-based models and inference frameworks (vLLM, TensorRT-LLM, SGLang, ONNX Runtime)
  • Proficiency in Python and C++ (Java is a plus)
  • Hands-on experience with PyTorch (TorchCompile, graph-level optimization) and/or TensorFlow
  • Knowledge of low-level hardware concepts (GPU memory hierarchy, caching, vectorization)
  • Familiarity with cloud platforms (AWS, GCP, Azure) and AI deployment tools (Docker, Kubernetes, MLflow)

Responsibilities

  • Develop and optimize AI runtimes for LLMs, ASR, and MT systems with a focus on performance and cost efficiency
  • Apply GPU-level optimization techniques including CUDA, kernel fusion, and memory throughput improvements
  • Implement inference optimizations such as TorchCompile, graph optimization, KV cache, and continuous batching
  • Build scalable, highly available infrastructure services to support enterprise-grade AI workloads
  • Optimize models for edge devices (laptops, PCs and mobile devices) as well as large-scale cloud deployments
  • Continuously improve latency, throughput, and efficiency across serving pipelines
  • Rapidly integrate and optimize new industry models to stay ahead in AI infrastructure

Skills

CUDA
TorchCompile
vLLM
TensorRT-LLM
SGLang
ONNX Runtime
KV cache
continuous batching
kernel fusion
graph optimization
LLMs
ASR
transformer-based models

Zoom

Video conferencing and online meeting solutions

About Zoom

Zoom provides video conferencing and online meeting solutions that allow users to conduct virtual meetings, webinars, and collaborative sessions. Its main product is video conferencing software, which enables high-quality video and audio communication, along with features like screen sharing, group messaging, and virtual backgrounds. Zoom also offers specialized products for larger events, such as Zoom Webinars and Zoom Events. The company operates on a freemium model, providing basic services for free while charging for advanced features through subscription plans tailored for various users, including businesses, educational institutions, and healthcare providers. Zoom stands out from competitors due to its user-friendly interface, reliable performance, and scalability for different needs, making it a vital tool for remote work, online education, telehealth, and social interactions.

San Jose, CaliforniaHeadquarters
2013Year Founded
$144.5MTotal Funding
IPOCompany Stage
Enterprise Software, Education, HealthcareIndustries
10,001+Employees

Benefits

Health Insurance
Dental Insurance
Vision Insurance
Life Insurance
Disability Insurance
Hybrid Work Options
Flexible Work Hours
Stock Options
Company Equity
Paid Vacation
Paid Sick Leave

Risks

Increased competition from Microsoft Teams and Google Meet threatens Zoom's market share.
Privacy concerns and regulatory scrutiny could impact Zoom's operations and reputation.
Hybrid work models may reduce demand for virtual meetings, affecting Zoom's growth.

Differentiation

Zoom offers a user-friendly interface with reliable performance for virtual meetings.
The platform supports diverse needs, including remote work, education, and telehealth.
Zoom's freemium model attracts a wide range of users with scalable subscription options.

Upsides

Zoom integrates AI tools to enhance virtual meeting effectiveness and productivity.
The expansion of 5G networks improves Zoom's video conferencing quality and accessibility.
Zoom's secure, HIPAA-compliant solutions drive demand in the telehealth sector.

Land your dream remote job 3x faster with AI