Data Operations Manager - Computer Use & Tool Use at Anthropic

San Francisco, California, United States

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level

Full TimeJob Type

UnknownVisa

AI, TechnologyIndustries

Requirements

3+ years in technical operations, product management, or entrepreneurial experience building from zero to scale
Strong technical foundations - proficiency in Python and understanding of ML workflows, RL environments, and evaluation frameworks
Strong communication skills and ability to effectively engage with both technical and non-technical stakeholders
Familiarity with how LLMs work and ability to describe concepts like RLHF, tool use, and agentic workflows
Understanding of the unique challenges of evaluating autonomous systems and long-horizon agent behaviors
Highly organized and able to manage multiple parallel workstreams effectively
High threshold for navigating ambiguity and ability to balance strategic priorities with rapid execution
Thrive in fast-paced research environments with shifting priorities and novel technical challenges
Passionate about AI safety and understanding of the critical importance of high-quality data in building safe, capable agentic systems

Responsibilities

Develop and execute data strategies for computer use, tool use safety, and agentic AI research
Partner with research leaders to translate technical requirements into operational frameworks
Build data collection and evaluation systems for complex scenarios: prompt injection robustness, multi-turn agent conversations, adversarial attacks, autonomous workflows
Scale the generation of realistic evaluation environments that capture real-world tool use and computer use challenges
Identify, evaluate, and manage specialized contractors and vendors for technical data collection
Implement quality control processes to ensure data meets training requirements for both capabilities and safety
Manage multiple complex projects simultaneously, balancing research velocity with rigorous evaluation standards
Track metrics and communicate progress to stakeholders

Skills

Key technologies and capabilities for this role

Data StrategyData OperationsVendor ManagementData PipelinesAI ResearchTraining DataAutonomous AgentsTool Use SafetyComputer UseAgentic AIData CollectionEvaluation Systems

Questions & Answers

Common questions about this position

What experience is required for this Data Operations Manager role?

Candidates should have 3+ years in technical operations, product management, or entrepreneurial experience building from zero to scale, along with strong technical foundations including proficiency in Python and understanding of ML workflows, RL environments, and evaluation frameworks.

What technical skills are needed for this position?

Proficiency in Python is required, along with a strong understanding of ML workflows, RL environments, and evaluation frameworks.

What is the compensation for this role?

This information is not specified in the job description.

Is this position remote or does it require office work?

This information is not specified in the job description.

What makes a strong candidate for this role?

A strong candidate has 3+ years in technical operations or similar, strong technical foundations like Python proficiency and ML knowledge, and excellent communication skills to engage with technical and non-technical stakeholders, while thriving at the intersection of technical depth and operational excellence.

Anthropic

Develops reliable and interpretable AI systems

About Anthropic

Anthropic focuses on creating reliable and interpretable AI systems. Its main product, Claude, serves as an AI assistant that can manage tasks for clients across various industries. Claude utilizes advanced techniques in natural language processing, reinforcement learning, and code generation to perform its functions effectively. What sets Anthropic apart from its competitors is its emphasis on making AI systems that are not only powerful but also understandable and controllable by users. The company's goal is to enhance operational efficiency and improve decision-making for its clients through the deployment and licensing of its AI technologies.

San Francisco, CaliforniaHeadquarters

2021Year Founded

$11,482.1MTotal Funding

GROWTH_EQUITY_VCCompany Stage

Enterprise Software, AI & Machine LearningIndustries

1,001-5,000Employees

Benefits

Flexible Work Hours

Paid Vacation

Parental Leave

Hybrid Work Options

Company Equity

Risks

Ongoing lawsuit with Concord Music Group could lead to financial liabilities.

Technological lag behind competitors like OpenAI may impact market position.

Reliance on substantial funding rounds may indicate financial instability.

Differentiation

Anthropic focuses on AI safety, contrasting with competitors' commercial priorities.

Claude, Anthropic's AI assistant, is designed for tasks of any scale.

Partnerships with tech giants like Panasonic and Amazon enhance Anthropic's strategic positioning.

Upsides

Anthropic's $60 billion valuation reflects strong investor confidence and growth potential.

Collaborations like the Umi app with Panasonic tap into the growing wellness AI market.

Focus on AI safety aligns with increasing industry emphasis on ethical AI development.

Land your dream remote job 3x faster with AI

Try Jobo Free