Senior Machine Learning Engineer at Zscaler

San Jose, California, United States

Zscaler Logo
Not SpecifiedCompensation
Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
Cybersecurity, Cloud Security, TechnologyIndustries

Requirements

  • BS in CS (or related) with 4+ years experience, MS with 2+ years, or PhD with experience delivering ML/GenAI features to production
  • Exceptional problem-solving skills driven by first-principles thinking, applying expertise in programming, data, and machine learning
  • Proven experience in the full ML model lifecycle—building, deployment, monitoring, and optimization
  • Hands-on experience with modern GenAI stacks (e.g., LangChain/LangGraph, CrewAI, vector stores, RAG, prompts/memory, evaluators)
  • Preferred Qualifications
  • Prior delivery of agentic/LLM systems in production, including context engineering and memory management strategies
  • Experience fine-tuning and serving LLMs/SLMs at scale (latency, cost, safety, evals)
  • Solid distributed systems fundamentals (APIs, queues, caching, concurrency) and cloud experience (Docker/Kubernetes, CI/CD; AWS/GCP/Azure)

Responsibilities

  • Build agentic AI features: implement tool-use workflows (planning, memory, context), retrieval/RAG, and evaluators; harden for scale and reliability
  • Ship resilient services: design and operate microservices, data/feature pipelines, and low-latency inference paths with solid observability
  • Operate with excellence: add tests, monitors, tracing, dashboards; participate in on-call with an automation-first mindset

Skills

Machine Learning
Agentic AI
Tool-use workflows
Planning
Memory
Context
Retrieval
RAG
Evaluators
Scalability

Zscaler

Cloud-based cybersecurity and secure gateway services

About Zscaler

Zscaler provides cloud-based information security services, focusing on internet, web, and cloud security. Its platform functions as a secure gateway that inspects all internet traffic between users and applications, ensuring that threats are identified and stopped before they can access a client's network. This service is offered through a subscription model, allowing large enterprises and government organizations to select the level of security that meets their needs. Zscaler differentiates itself from competitors by offering a strong partner program that enhances market reach and provides partners with training and resources. The company's goal is to support secure digital transformation for its clients by delivering reliable security solutions.

San Jose, CaliforniaHeadquarters
2008Year Founded
$148.8MTotal Funding
IPOCompany Stage
Enterprise Software, CybersecurityIndustries
5,001-10,000Employees

Benefits

Comprehensive health plans
Supportive parental & family leave
On-demand learning & development
Company-sponsored volunteering
Global tuition assistance program
Guilt-free paid time off

Risks

Emerging cybersecurity firms may erode Zscaler's market share.
Economic downturns could impact Zscaler's subscription-based revenue model.
The retirement of CFO Mr. Canessa may lead to financial instability.

Differentiation

Zscaler offers a 100% cloud-based security platform, eliminating on-premise hardware needs.
The company is a Gartner magic quadrant leader for secure web gateways.
Zscaler's platform inspects all internet traffic, ensuring threats are neutralized pre-network.

Upsides

Zscaler's FY/25 guidance was revised upward, indicating strong financial performance.
The partnership with Bharti Airtel enhances Zscaler's zero-trust architecture offerings.
Zscaler's hiring of government experts strengthens its position in the public sector.

Land your dream remote job 3x faster with AI