Software Engineer, Inference at Anthropic

Dublin, County Dublin, Ireland

Apply Now

Not SpecifiedCompensation

Mid-level (3 to 4 years), Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

Artificial Intelligence, TechnologyIndustries

Requirements

Significant software engineering experience
Results-oriented, with a bias towards flexibility and impact
Willingness to pick up slack, even if it goes outside your job description
Enjoy pair programming
Interest in learning more about machine learning research
Care about the societal impacts of your work
At least a Bachelor's degree in a related field or equivalent experience

Responsibilities

Optimizing inference request routing to maximize compute efficiency
Autoscaling the compute fleet to effectively match compute supply with inference demand
Contributing to new inference features (e.g., structured sampling, fine tuning)
Supporting inference for new model architectures
Ensuring smooth and regular deployment of inference services
Analyzing observability data to tune performance based on production workloads
Building and maintaining critical systems that serve LLMs
Scaling inference systems
Ensuring reliability of inference systems
Optimizing compute resource efficiency
Developing new inference capabilities
Tackling complex distributed systems challenges across the inference stack (e.g., optimal request routing, efficient prompt caching)

Skills

Key technologies and capabilities for this role

PythonKubernetesDistributed SystemsMachine LearningLLM OptimizationBatchingCachingAutoscalingPrompt CachingRequest Routing

Questions & Answers

Common questions about this position

What is the salary range for the Software Engineer, Inference position?

The expected salary range is €220,000 - €295,000 EUR annually.

What is the location and hybrid work policy?

The role follows a location-based hybrid policy where staff are expected to be in one of the offices at least 25% of the time, though some roles may require more.

What skills and experiences are required or preferred for this role?

Significant software engineering experience is required. Strong candidates may have experience with high performance large-scale distributed systems, implementing and deploying ML systems at scale, LLM optimization like batching and caching, Kubernetes, and Python.

What is the culture like at Anthropic?

The team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders. They value being results-oriented with a bias towards flexibility and impact, picking up slack outside job descriptions, pair programming, learning about ML research, and caring about societal impacts.

What makes a strong candidate for this position?

Strong candidates have significant software engineering experience, are results-oriented and flexible, enjoy pair programming, and have experience in distributed systems, ML deployment, or LLM optimization. Apply even if you don't meet every qualification, as not all strong candidates will.

Anthropic

Develops reliable and interpretable AI systems

About Anthropic

Anthropic focuses on creating reliable and interpretable AI systems. Its main product, Claude, serves as an AI assistant that can manage tasks for clients across various industries. Claude utilizes advanced techniques in natural language processing, reinforcement learning, and code generation to perform its functions effectively. What sets Anthropic apart from its competitors is its emphasis on making AI systems that are not only powerful but also understandable and controllable by users. The company's goal is to enhance operational efficiency and improve decision-making for its clients through the deployment and licensing of its AI technologies.

San Francisco, CaliforniaHeadquarters

2021Year Founded

$11,482.1MTotal Funding

GROWTH_EQUITY_VCCompany Stage

Enterprise Software, AI & Machine LearningIndustries

1,001-5,000Employees

Benefits

Flexible Work Hours

Paid Vacation

Parental Leave

Hybrid Work Options

Company Equity

Risks

Ongoing lawsuit with Concord Music Group could lead to financial liabilities.

Technological lag behind competitors like OpenAI may impact market position.

Reliance on substantial funding rounds may indicate financial instability.

Differentiation

Anthropic focuses on AI safety, contrasting with competitors' commercial priorities.

Claude, Anthropic's AI assistant, is designed for tasks of any scale.

Partnerships with tech giants like Panasonic and Amazon enhance Anthropic's strategic positioning.

Upsides

Anthropic's $60 billion valuation reflects strong investor confidence and growth potential.

Collaborations like the Umi app with Panasonic tap into the growing wellness AI market.

Focus on AI safety aligns with increasing industry emphasis on ethical AI development.

Land your dream remote job 3x faster with AI

Try Jobo Free