Staff Software Engineer, Inference at Anthropic

Dublin, County Dublin, Ireland

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level

Full TimeJob Type

UnknownVisa

AI, TechnologyIndustries

Requirements

Bachelor's degree in a related field or equivalent experience
Significant software engineering experience, particularly with distributed systems
Familiarity with performance optimization, distributed systems, large-scale service orchestration, and intelligent request routing
Experience with high-performance, large-scale distributed systems
Experience implementing and deploying machine learning systems at scale
Experience with load balancing, request routing, or traffic management systems
Proficiency in Python or Rust
Familiarity with Kubernetes and cloud infrastructure (AWS, GCP) (preferred)
Familiarity with LLM inference optimization, batching strategies, and multi-accelerator deployments (preferred)
Ability to work in one of the offices at least 25% of the time (location-based hybrid policy)

Responsibilities

Work end-to-end to identify and address key infrastructure blockers for serving Claude to millions of users
Maximize compute efficiency to support customer growth
Enable high-performance inference infrastructure for scientists developing next-generation models
Design intelligent routing algorithms to optimize request distribution across thousands of accelerators
Implement autoscaling for compute fleets to match supply with demand across production, research, and experimental workloads
Build production-grade deployment pipelines for releasing new models to millions of users
Integrate new AI accelerator platforms to maintain hardware-agnostic advantage
Contribute to new inference features (e.g., structured sampling, prompt caching)
Support inference for new model architectures
Analyze observability data to tune performance based on real-world production workloads
Manage multi-region deployments and geographic routing for global customers

Skills

Distributed Systems

Performance Optimization

Kubernetes

Cloud Infrastructure

Load Balancing

Request Routing

Traffic Management

LLM Inference

Batching Strategies

Caching Strategies

Machine Learning Systems

Multi-Accelerator Deployments

Anthropic

Develops reliable and interpretable AI systems

About Anthropic

Anthropic focuses on creating reliable and interpretable AI systems. Its main product, Claude, serves as an AI assistant that can manage tasks for clients across various industries. Claude utilizes advanced techniques in natural language processing, reinforcement learning, and code generation to perform its functions effectively. What sets Anthropic apart from its competitors is its emphasis on making AI systems that are not only powerful but also understandable and controllable by users. The company's goal is to enhance operational efficiency and improve decision-making for its clients through the deployment and licensing of its AI technologies.

San Francisco, CaliforniaHeadquarters

2021Year Founded

$11,482.1MTotal Funding

GROWTH_EQUITY_VCCompany Stage

Enterprise Software, AI & Machine LearningIndustries

1,001-5,000Employees

Benefits

Flexible Work Hours

Paid Vacation

Parental Leave

Hybrid Work Options

Company Equity

Risks

Ongoing lawsuit with Concord Music Group could lead to financial liabilities.

Technological lag behind competitors like OpenAI may impact market position.

Reliance on substantial funding rounds may indicate financial instability.

Differentiation

Anthropic focuses on AI safety, contrasting with competitors' commercial priorities.

Claude, Anthropic's AI assistant, is designed for tasks of any scale.

Partnerships with tech giants like Panasonic and Amazon enhance Anthropic's strategic positioning.

Upsides

Anthropic's $60 billion valuation reflects strong investor confidence and growth potential.

Collaborations like the Umi app with Panasonic tap into the growing wellness AI market.

Focus on AI safety aligns with increasing industry emphasis on ethical AI development.

Land your dream remote job 3x faster with AI

Try Jobo Free