Engineering Manager, AI Quality at Harvey

San Francisco, California, United States

Apply Now

$297,000 – $390,000Compensation

Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level

Full TimeJob Type

UnknownVisa

Legal Tech, Professional Services, AIIndustries

Requirements

Significant industry experience leading AI or other related quality efforts (search or ads ranking systems, recommender systems, etc) at industry-leading companies
Excellent software engineering skills; experience working in teams that built and operated production systems
Excellent communication skills, both written and verbal
Ability to roll up your sleeves and build team, processes, and technology from the ground up
A strong academic or professional background in Machine Learning, Generative AI, Information Retrieval or other related fields

Responsibilities

Establish an AI & Results Quality Program at Harvey: Establish offline and online eval processes and tools, and a culture of continuous iteration and experimentation
Build out core AI quality building blocks that can be reused across different teams and surface areas
Own search & retrieval quality, both for AI applications as well as other use cases
Work closely with product engineering to continuously improve the quality and capabilities of our AI & search products
Work closely with platform engineering to scale our capabilities
Drive overall AI & results quality across all of Harvey’s products (Assistant, Harvey Word, Vault, Workflows & Agents, and net new products)

Skills

Key technologies and capabilities for this role

AIAgentic AISearch SystemsEvaluation ProcessesQuality AssuranceEngineering ManagementAI Building Blocks

Questions & Answers

Common questions about this position

What is the salary range for the Engineering Manager, AI Quality role?

The salary range is $297K - $390K.

Is this position remote or hybrid?

The position is hybrid.

What skills and experience are required for this role?

Candidates need significant industry experience leading AI or related quality efforts such as search, ads ranking, or recommender systems at leading companies, along with excellent software engineering skills.

What is the company culture like at Harvey?

The team is sharp, motivated, and deeply committed to the mission, moving fast with intensity, taking real ownership, staying close to customers, and thriving in ambiguity while pushing for excellence.

What makes a strong candidate for this Engineering Manager role?

A strong candidate has significant experience leading AI quality efforts at industry-leading companies and excellent software engineering skills, with the ability to establish evaluation processes, build reusable AI tools, and foster a culture of experimentation and iteration.

Harvey

Custom AI solutions for law firms

About Harvey

Harvey.ai builds custom Large Language Models (LLMs) specifically designed for top law firms to help them tackle complex legal challenges. These AI models are tailored to various legal practice areas and jurisdictions, allowing firms to enhance their efficiency and accuracy in legal work. Harvey.ai's technology includes an AI chatbot developed in collaboration with Allen & Overy, which demonstrates how their solutions can streamline operations and reduce manual workloads. The company operates on a business model that combines customization fees for developing these models with ongoing subscription fees for support and updates. Unlike many competitors, Harvey.ai focuses exclusively on the legal sector, ensuring that their products meet the unique needs of elite law firms. The goal of Harvey.ai is to transform the legal industry by providing advanced AI tools that improve decision-making and operational efficiency while maintaining high standards of data security.

San Francisco, CaliforniaHeadquarters

2022Year Founded

$200.4MTotal Funding

SERIES_CCompany Stage

Cybersecurity, LegalIndustries

201-500Employees

Risks

Over-reliance on partnerships could lead to strategic vulnerabilities if they dissolve.

LexLegis.ai's global expansion poses a competitive threat in legal research.

Rapid AI innovation and crowded CLM market may challenge Harvey's growth.

Differentiation

Harvey offers custom LLMs tailored for elite law firms' complex legal challenges.

The company provides a unified interface for legal workflows, enhancing efficiency.

Harvey's BigLaw Bench evaluates AI accuracy in legal tasks, setting industry standards.

Upsides

Partnership with Icertis enhances contract analysis and risk assessment capabilities.

Expansion into Japan with Mori Hamada Matsumoto opens new revenue streams.

Revamped GenAI Assistant improves user experience and output quality for legal professionals.

Land your dream remote job 3x faster with AI

Try Jobo Free