Research Scientist/Engineer, Alignment Finetuning at Anthropic

San Francisco, California, United States

Apply Now

$280,000 – $425,000Compensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

Artificial Intelligence, Machine LearningIndustries

Requirements

MS/PhD in Computer Science, ML, or related field, or equivalent experience
Strong programming skills, especially in Python
Experience with ML model training and experimentation
A track record of implementing ML research
Strong analytical skills for interpreting experimental results
Experience with ML metrics and evaluation frameworks
Excel at turning research ideas into working code

Responsibilities

Develop and implement novel finetuning techniques using synthetic data generation and advanced training pipelines
Use these to train models to have better alignment properties including honesty, character, and harmlessness
Create and maintain evaluation frameworks to measure alignment properties in models
Collaborate across teams to integrate alignment improvements into production models
Develop processes to help automate and scale the work of the team

Skills

Key technologies and capabilities for this role

PythonML TrainingFinetuningSynthetic Data GenerationRLHFConstitutional AIReward ModelingEvaluation FrameworksAI Alignment

Questions & Answers

Common questions about this position

What is the salary range for this Research Scientist/Engineer position?

The salary range is $280,000 - $425,000 USD.

Is this role remote or hybrid, and what are the office requirements?

The role is hybrid, with staff expected to be in one of the offices at least 25% of the time, though some roles may require more.

What are the key required skills for this position?

Key requirements include MS/PhD in Computer Science, ML, or related field; strong Python programming skills; experience with ML model training and experimentation; a track record of implementing ML research; strong analytical skills; experience with ML metrics and evaluation; and excelling at turning research ideas into working code.

What is the company culture like at Anthropic?

Anthropic is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build reliable, interpretable, steerable, safe, and beneficial AI systems.

What makes a strong candidate for this role?

Strong candidates have experience with language model finetuning, AI alignment research, published ML or alignment work, synthetic data generation, familiarity with RLHF, constitutional AI, reward modeling, and a track record of designing novel training approaches and model evaluation.

Anthropic

Develops reliable and interpretable AI systems

About Anthropic

Anthropic focuses on creating reliable and interpretable AI systems. Its main product, Claude, serves as an AI assistant that can manage tasks for clients across various industries. Claude utilizes advanced techniques in natural language processing, reinforcement learning, and code generation to perform its functions effectively. What sets Anthropic apart from its competitors is its emphasis on making AI systems that are not only powerful but also understandable and controllable by users. The company's goal is to enhance operational efficiency and improve decision-making for its clients through the deployment and licensing of its AI technologies.

San Francisco, CaliforniaHeadquarters

2021Year Founded

$11,482.1MTotal Funding

GROWTH_EQUITY_VCCompany Stage

Enterprise Software, AI & Machine LearningIndustries

1,001-5,000Employees

Benefits

Flexible Work Hours

Paid Vacation

Parental Leave

Hybrid Work Options

Company Equity

Risks

Ongoing lawsuit with Concord Music Group could lead to financial liabilities.

Technological lag behind competitors like OpenAI may impact market position.

Reliance on substantial funding rounds may indicate financial instability.

Differentiation

Anthropic focuses on AI safety, contrasting with competitors' commercial priorities.

Claude, Anthropic's AI assistant, is designed for tasks of any scale.

Partnerships with tech giants like Panasonic and Amazon enhance Anthropic's strategic positioning.

Upsides

Anthropic's $60 billion valuation reflects strong investor confidence and growth potential.

Collaborations like the Umi app with Panasonic tap into the growing wellness AI market.

Focus on AI safety aligns with increasing industry emphasis on ethical AI development.

Land your dream remote job 3x faster with AI

Try Jobo Free