Research Engineer, Model Performance & Quality at Anthropic

Seattle, Washington, United States

Apply Now

Not SpecifiedCompensation

Mid-level (3 to 4 years), Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

AI, TechnologyIndustries

Requirements

Proficient in Python and have experience building production ML systems
Have experience with training, evaluating, or monitoring large language models
At least a Bachelor's degree in a related field or equivalent experience
Ability to be in one of the offices at least 25% of the time (location-based hybrid policy)

Responsibilities

Build comprehensive training observability systems - Design and implement monitoring infrastructure to track model behaviors during training
Develop next-generation evaluation frameworks - Create evaluations beyond traditional benchmarks to capture real-world utility
Create automated quality assessment pipelines - Build custom classifiers to monitor RL transcripts for complex issues
Bridge research and production - Partner with research teams to translate evaluation techniques into production systems and work with engineering teams to scale monitoring infrastructure

Skills

Key technologies and capabilities for this role

PythonMachine LearningLarge Language ModelsModel TrainingModel EvaluationMonitoring SystemsDistributed SystemsEvaluation FrameworksClassifiersRL Transcripts

Questions & Answers

Common questions about this position

What is the expected salary range for this Research Engineer position?

This information is not specified in the job description.

Is this Research Engineer role remote or does it require office work?

This information is not specified in the job description.

What skills are required for the Research Engineer role on the Model Performance team?

Proficiency in Python, experience building production ML systems, experience with training, evaluating, or monitoring large language models, strong analytical skills, and the ability to balance research exploration with engineering rigor are required.

What is the company culture like at Anthropic?

Anthropic has a quickly growing team of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems, emphasizing collaborative problem-solving across diverse teams.

What makes a strong candidate for this Research Engineer position?

Strong candidates have experience with reinforcement learning and language model training pipelines, designing evaluation frameworks, production monitoring, statistical analysis, and knowledge of AI safety, but do not need formal credentials, academic publications, or prior AI safety experience.

Anthropic

Develops reliable and interpretable AI systems

About Anthropic

Anthropic focuses on creating reliable and interpretable AI systems. Its main product, Claude, serves as an AI assistant that can manage tasks for clients across various industries. Claude utilizes advanced techniques in natural language processing, reinforcement learning, and code generation to perform its functions effectively. What sets Anthropic apart from its competitors is its emphasis on making AI systems that are not only powerful but also understandable and controllable by users. The company's goal is to enhance operational efficiency and improve decision-making for its clients through the deployment and licensing of its AI technologies.

San Francisco, CaliforniaHeadquarters

2021Year Founded

$11,482.1MTotal Funding

GROWTH_EQUITY_VCCompany Stage

Enterprise Software, AI & Machine LearningIndustries

1,001-5,000Employees