Engineering Manager, AI Quality at Harvey

San Francisco, California, United States

Harvey Logo
$297,000 – $390,000Compensation
Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level
Full TimeJob Type
UnknownVisa
Legal Tech, Professional Services, AIIndustries

Requirements

  • Significant industry experience leading AI or other related quality efforts (search or ads ranking systems, recommender systems, etc) at industry-leading companies
  • Excellent software engineering skills; experience working in teams that built and operated production systems
  • Excellent communication skills, both written and verbal
  • Ability to roll up your sleeves and build team, processes, and technology from the ground up
  • A strong academic or professional background in Machine Learning, Generative AI, Information Retrieval or other related fields

Responsibilities

  • Establish an AI & Results Quality Program at Harvey: Establish offline and online eval processes and tools, and a culture of continuous iteration and experimentation
  • Build out core AI quality building blocks that can be reused across different teams and surface areas
  • Own search & retrieval quality, both for AI applications as well as other use cases
  • Work closely with product engineering to continuously improve the quality and capabilities of our AI & search products
  • Work closely with platform engineering to scale our capabilities
  • Drive overall AI & results quality across all of Harvey’s products (Assistant, Harvey Word, Vault, Workflows & Agents, and net new products)

Skills

AI
Agentic AI
Search Systems
Evaluation Processes
Quality Assurance
Engineering Management
AI Building Blocks

Harvey

Custom AI solutions for law firms

About Harvey

Harvey.ai builds custom Large Language Models (LLMs) specifically designed for top law firms to help them tackle complex legal challenges. These AI models are tailored to various legal practice areas and jurisdictions, allowing firms to enhance their efficiency and accuracy in legal work. Harvey.ai's technology includes an AI chatbot developed in collaboration with Allen & Overy, which demonstrates how their solutions can streamline operations and reduce manual workloads. The company operates on a business model that combines customization fees for developing these models with ongoing subscription fees for support and updates. Unlike many competitors, Harvey.ai focuses exclusively on the legal sector, ensuring that their products meet the unique needs of elite law firms. The goal of Harvey.ai is to transform the legal industry by providing advanced AI tools that improve decision-making and operational efficiency while maintaining high standards of data security.

San Francisco, CaliforniaHeadquarters
2022Year Founded
$200.4MTotal Funding
SERIES_CCompany Stage
Cybersecurity, LegalIndustries
201-500Employees

Risks

Over-reliance on partnerships could lead to strategic vulnerabilities if they dissolve.
LexLegis.ai's global expansion poses a competitive threat in legal research.
Rapid AI innovation and crowded CLM market may challenge Harvey's growth.

Differentiation

Harvey offers custom LLMs tailored for elite law firms' complex legal challenges.
The company provides a unified interface for legal workflows, enhancing efficiency.
Harvey's BigLaw Bench evaluates AI accuracy in legal tasks, setting industry standards.

Upsides

Partnership with Icertis enhances contract analysis and risk assessment capabilities.
Expansion into Japan with Mori Hamada Matsumoto opens new revenue streams.
Revamped GenAI Assistant improves user experience and output quality for legal professionals.

Land your dream remote job 3x faster with AI