Staff Software Engineer, Backend Platform at Harvey

San Francisco, California, United States

Apply Now

$238,000 – $290,000Compensation

Mid-level (3 to 4 years), Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

Legal Tech, AI, Professional ServicesIndustries

Requirements

Mid-to-senior level backend engineering experience (implied by role level and responsibilities)
Expertise in building and operating backend platforms, frameworks, and libraries
Proficiency with modern backend architecture patterns like asynchronous I/O (asyncio) and streaming data processing
Experience with APIs, service templates, versioned interfaces, caching, messaging primitives, error handling, authorization, data governance, and event processing
Ability to design abstractions for GenAI-native applications, including high-throughput model inference, streaming/long-running API interactions, retrieval, context handling, and prompt lifecycle
Skills in embedding reliability and observability (tracing, metrics, automated tests)
Willingness to work in-person 3 days a week in San Francisco, CA (relocation assistance offered)
Thrives in ambiguity, pushes for excellence, moves fast, takes ownership, and collaborates across teams

Responsibilities

Develop and maintain internal backend frameworks and libraries providing common capabilities (API routing, service lifecycle management, caching and messaging primitives, error handling interfaces, etc.)
Create and improve APIs, service templates, and versioned interfaces to establish consistent patterns for building new services and features
Introduce and champion modern backend architecture patterns like asynchronous I/O (asyncio) and streaming data processing for better performance and scalability
Design Harvey-specific abstractions and domain-specific frameworks for cross-cutting concerns (e.g., authorization, streaming) and areas like data governance and event processing
Embed reliability and observability into the platform with tracing, metrics, and automated tests (shift-left)
Collaborate with Model Infrastructure team on GenAI challenges (high-throughput model inference, streaming/long-running APIs, retrieval, context handling, prompt lifecycle)
Collaborate with Developer Experience and Infrastructure teams to integrate platform components into deployment, CI/CD pipelines, build tools, and release infrastructure

Skills

Key technologies and capabilities for this role

BackendPlatform EngineeringFrameworksLibrariesReliabilityPerformanceDeveloper ExperienceObservability

Questions & Answers

Common questions about this position

What is the salary range for this Staff Software Engineer role?

The salary range is $238K - $290K.

Is this role remote or based in an office?

This role is based in San Francisco, CA, with an in-person work model requiring 3 days a week in the office. Relocation assistance is offered to new employees.

What key skills are required for this Backend Platform Engineer position?

Key skills include developing backend frameworks and libraries for API routing, service lifecycle management, caching, messaging, and error handling, as well as expertise in modern backend architecture patterns like asynchronous I/O (asyncio) and streaming data processing.

What is the company culture like at Harvey?

The team is sharp, motivated, and deeply committed to the mission, moving fast with intensity, taking real ownership, staying close to customers, and thriving in ambiguity while pushing for excellence.

What makes a strong candidate for this role?

Strong candidates are excited about building foundational systems, solving cross-cutting technical challenges, enabling others to move faster, and thrive in a high-impact environment that amplifies engineering productivity across the company.

Harvey

Custom AI solutions for law firms

About Harvey

Harvey.ai builds custom Large Language Models (LLMs) specifically designed for top law firms to help them tackle complex legal challenges. These AI models are tailored to various legal practice areas and jurisdictions, allowing firms to enhance their efficiency and accuracy in legal work. Harvey.ai's technology includes an AI chatbot developed in collaboration with Allen & Overy, which demonstrates how their solutions can streamline operations and reduce manual workloads. The company operates on a business model that combines customization fees for developing these models with ongoing subscription fees for support and updates. Unlike many competitors, Harvey.ai focuses exclusively on the legal sector, ensuring that their products meet the unique needs of elite law firms. The goal of Harvey.ai is to transform the legal industry by providing advanced AI tools that improve decision-making and operational efficiency while maintaining high standards of data security.

San Francisco, CaliforniaHeadquarters

2022Year Founded

$200.4MTotal Funding

SERIES_CCompany Stage

Cybersecurity, LegalIndustries

201-500Employees

Risks

Over-reliance on partnerships could lead to strategic vulnerabilities if they dissolve.

LexLegis.ai's global expansion poses a competitive threat in legal research.

Rapid AI innovation and crowded CLM market may challenge Harvey's growth.

Differentiation

Harvey offers custom LLMs tailored for elite law firms' complex legal challenges.

The company provides a unified interface for legal workflows, enhancing efficiency.

Harvey's BigLaw Bench evaluates AI accuracy in legal tasks, setting industry standards.

Upsides

Partnership with Icertis enhances contract analysis and risk assessment capabilities.

Expansion into Japan with Mori Hamada Matsumoto opens new revenue streams.

Revamped GenAI Assistant improves user experience and output quality for legal professionals.

Land your dream remote job 3x faster with AI

Try Jobo Free