Software Engineer, Agents Runtime at Glean

San Francisco, California, United States

Apply Now

Not SpecifiedCompensation

Mid-level (3 to 4 years), Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

AI, Technology, Enterprise SoftwareIndustries

Requirements

3+ years of software engineering experience building production distributed systems or cloud-native applications
BS/BA in Computer Science or related field, or equivalent practical experience
Strong coding skills in at least one of: Python, Go, Java, or C++, with a focus on reliability, performance, and tests
Product-minded: prioritize customer impact, clear SLAs/SLOs, and pragmatic iteration
Ownership-driven with a positive, proactive attitude; comfortable leading projects or learning from battle-tested engineers
Experience operating services on Kubernetes and at least one major cloud (e.g., GCP, AWS, or Azure)
Familiarity with event/streaming systems (e.g., Pub/Sub, Kafka), caching (e.g., Redis), and data stores for low-latency paths
Practical understanding of LLM/agents building blocks: tool/function calling, structured outputs, streaming, and model selection/routing
Strong observability and debugging skills: tracing (e.g., OpenTelemetry), metrics, dashboards, and production forensics
Background in one or more areas is a plus: policy/guardrails, multi-tenant isolation, rate-limiting, concurrency control, cost optimization

Responsibilities

Own impactful runtime problems end-to-end — from architecture and design to production launch and ongoing reliability
Build and evolve core services for session lifecycle, streaming responses (e.g., gRPC/WebSockets), structured tool execution, memory/state, and policy/guardrails
Design for performance, correctness, and cost: reduce p50/p95 latency, improve tail behavior, and optimize token/tool budgets
Integrate with leading LLM providers (e.g., OpenAI, Anthropic, Google Gemini) and internal evaluation frameworks to improve quality and predictability
Harden the platform with fault isolation, retries, timeouts, circuit-breaking, backpressure, and graceful degradation
Instrument deep observability (tracing, metrics, logs) and create playbooks/SLOs for high availability and on-call excellence
Collaborate closely with product, quality, and application teams to prioritize the most impactful roadmap investments

Skills

gRPC

WebSockets

Distributed Systems

Observability

ML Infrastructure

Streaming

Orchestration

Tool Calling

Model Routing

Guardrails

Glean

AI-powered search tool for workplace productivity

About Glean

Glean enhances workplace productivity by providing an AI-powered search tool that works across all applications within a company. This tool utilizes deep learning-based Language Models to understand natural language queries, allowing users to find information more easily. It continuously learns from the specific language and context of a company, improving the relevance of search results without manual adjustments. Additionally, Glean offers a chat assistant that can analyze and summarize information from various company documents and conversations, further increasing efficiency. Unlike many competitors, Glean's focus on natural language processing and its ability to adapt to a company's unique context set it apart. The goal of Glean is to streamline information retrieval in the workplace, making it accessible and efficient for all types of organizations, from startups to large enterprises.

Palo Alto, CaliforniaHeadquarters

2019Year Founded

$637.1MTotal Funding

SERIES_ECompany Stage

Enterprise Software, AI & Machine LearningIndustries

501-1,000Employees

Benefits

Healthcare - Happy and healthy go together. We cover medical, dental, and vision for you and yours.

Competitive compensation - Have a real stake in your job and your future with competitive stock options.

401(k) - We make it easy to save for the future today by contributing to a 401k.

Flexible work - We work 3 days a week in the office, though we believe in folks working where they can be most effective.

Company events - We work hard and play hard - from weekly happy hours to our annual company retreat.

Unlimited PTO - Flexible hours, PTO, company-wide summer and winter break shutdown

Transparent culture - By default we keep things open and accessible so we can make better decisions together, faster.

Learning and development - We offer a learning stipend to help you grow and achieve your goals.

Free meals - With lunch and dinner options every day, no need to work while you’re hungry.

Risks

Inflated valuations in AI could lead to financial instability for Glean.

Competition from tech giants like Microsoft and Amazon pressures Glean's market share.

Opening a new office in Bengaluru may strain resources and impact operational efficiency.

Differentiation

Glean uses AI to enhance workplace productivity with a unique search tool.

The platform integrates with enterprise data, providing personalized, context-aware search results.

Glean's AI assistant offers analyses and summaries, reducing time spent on information retrieval.

Upsides

Glean's $260M funding round doubled its valuation to $4.6 billion in 2023.

The rise of hybrid work models increases demand for Glean's seamless information retrieval tools.

Growing data privacy emphasis allows Glean to offer robust, compliant data hosting options.

Land your dream remote job 3x faster with AI

Try Jobo Free