Senior Software Engineer, Backend Platform at Harvey

San Francisco, California, United States

Apply Now

$200,000 – $260,000Compensation

Senior (5 to 8 years), Mid-level (3 to 4 years)Experience Level

Full TimeJob Type

UnknownVisa

Legal Tech, AI, Professional ServicesIndustries

Requirements

Mid-to-senior level experience in backend engineering
Expertise in designing and implementing shared frameworks and libraries (e.g., API routing, service lifecycle management, caching, messaging primitives, error handling)
Proficiency with modern backend architecture patterns like asynchronous I/O (asyncio) and streaming data processing
Experience building abstractions for cross-cutting concerns (e.g., authorization, streaming, data governance, event processing)
Knowledge of reliability and observability practices (tracing, metrics, automated tests)
Familiarity with challenges in GenAI-native applications (high-throughput model inference, streaming/long-running API interactions, retrieval, context handling, prompt lifecycle)
Ability to thrive in ambiguity, push for excellence, and collaborate across teams
Based in San Francisco, CA (in-person work model, 3 days a week; relocation assistance available)

Responsibilities

Develop and maintain internal backend frameworks and libraries providing common capabilities (API routing, service lifecycle management, caching and messaging primitives, error handling interfaces)
Create and improve APIs, service templates, and versioned interfaces for consistent patterns in building new services and features
Introduce and champion modern backend architecture patterns like asynchronous I/O (asyncio) and streaming data processing for performance and scalability
Design Harvey-specific abstractions and domain-specific frameworks for cross-cutting concerns (e.g., authorization, streaming) and areas like data governance and event processing
Embed reliability and observability into the platform (tracing, metrics, automated tests) to ensure robust, monitorable services
Collaborate with Model Infrastructure team on GenAI challenges (high-throughput model inference, streaming/long-running APIs, retrieval, context handling, prompt lifecycle)
Collaborate with Developer Experience and Infrastructure teams to integrate platform components into deployment, CI/CD pipelines, build tools, and release infrastructure

Skills

Key technologies and capabilities for this role

Backend EngineeringPlatform EngineeringFrameworksLibrariesReliability EngineeringPerformance OptimizationDeveloper ExperienceObservability

Questions & Answers

Common questions about this position

What is the salary range for this Senior Software Engineer role?

The salary range is $200K - $260K.

Is this role remote or based in an office?

This role is based in San Francisco, CA, with an in-person work model requiring 3 days a week in the office. Relocation assistance is offered to new employees.

What skills are required for this Backend Platform Engineer position?

Key skills include developing backend frameworks and libraries for API routing, service lifecycle management, caching, messaging, and error handling, as well as expertise in modern backend architecture patterns like asynchronous I/O (asyncio) and streaming data processing.

What is the company culture like at Harvey?

The team is sharp, motivated, and deeply committed to the mission, moving fast with intensity, taking real ownership, staying close to customers, and thriving in ambiguity while pushing for excellence.

What makes a strong candidate for this role?

Strong candidates are excited about building foundational systems, solving cross-cutting technical challenges, and enabling others to move faster, with experience in backend platform engineering at a mid-to-senior level.

Harvey

Custom AI solutions for law firms

About Harvey

Harvey.ai builds custom Large Language Models (LLMs) specifically designed for top law firms to help them tackle complex legal challenges. These AI models are tailored to various legal practice areas and jurisdictions, allowing firms to enhance their efficiency and accuracy in legal work. Harvey.ai's technology includes an AI chatbot developed in collaboration with Allen & Overy, which demonstrates how their solutions can streamline operations and reduce manual workloads. The company operates on a business model that combines customization fees for developing these models with ongoing subscription fees for support and updates. Unlike many competitors, Harvey.ai focuses exclusively on the legal sector, ensuring that their products meet the unique needs of elite law firms. The goal of Harvey.ai is to transform the legal industry by providing advanced AI tools that improve decision-making and operational efficiency while maintaining high standards of data security.

San Francisco, CaliforniaHeadquarters

2022Year Founded

$200.4MTotal Funding

SERIES_CCompany Stage

Cybersecurity, LegalIndustries

201-500Employees

Risks

Over-reliance on partnerships could lead to strategic vulnerabilities if they dissolve.

LexLegis.ai's global expansion poses a competitive threat in legal research.

Rapid AI innovation and crowded CLM market may challenge Harvey's growth.

Differentiation

Harvey offers custom LLMs tailored for elite law firms' complex legal challenges.

The company provides a unified interface for legal workflows, enhancing efficiency.

Harvey's BigLaw Bench evaluates AI accuracy in legal tasks, setting industry standards.

Upsides

Partnership with Icertis enhances contract analysis and risk assessment capabilities.

Expansion into Japan with Mori Hamada Matsumoto opens new revenue streams.

Revamped GenAI Assistant improves user experience and output quality for legal professionals.

Land your dream remote job 3x faster with AI

Try Jobo Free