AI Agent Software Engineer - Agent Performance Engineering at Assembled

San Francisco, California, United States

Apply Now

$135,000 – $280,000Compensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

Technology, AI, Customer SupportIndustries

Requirements

5+ years of experience in software engineering as an individual contributor
Experience with AI evaluation systems, data pipelines, or AI model optimization
Passionate about building systems that measure and improve AI performance
Worked with retrieval systems, knowledge bases, or information extraction
Enjoy building tools and infrastructure that enable other engineers and AI systems to perform better
Highly ambitious and driven, setting high goals for yourself and others
Put customers first, focusing on solving real problems that impact support quality
Enjoy fast-paced environments and can quickly adjust when new insights emerge
Have a bit of a maverick streak that helps you come up with creative solutions
Have made a noticeable impact on small teams and have solid experience in startups or smaller companies
Stay humble and open to feedback, value teamwork, and are always ready to learn

Responsibilities

Build foundational evaluation infrastructure: Develop comprehensive evaluation systems from the ground up, including golden dataset creation, automated benchmarking, and model comparison tools to measure and optimize AI agent performance across all communication channels
Automate knowledge generation: Design and implement systems that automatically create synthetic guides, documentation, and metadata to improve agent knowledge bases using cutting-edge approaches to knowledge extraction and augmentation
Optimize AI agent accuracy: Enhance retrieval systems, implement advanced prompt optimization techniques, and build tools that continuously improve agent responses through automated evaluation and refinement
Develop intelligence infrastructure: Architect systems that enable rapid model upgrades, A/B testing of different AI approaches, and scalable evaluation pipelines that support enterprise deployment
Drive volume automation: Focus on maximizing automated resolutions across voice, chat, and email by building the intelligence systems that make it possible

Skills

Key technologies and capabilities for this role

AI AgentsEvaluation SystemsKnowledge AutomationAI OptimizationEvaluation InfrastructureScalable Infrastructure

Questions & Answers

Common questions about this position

What is the salary range for the AI Agent Software Engineer position?

The salary range is $135K - $280K.

Is this role remote or hybrid, and what are the location requirements?

The position is hybrid.

What key responsibilities and skills are required for this role?

The role requires building evaluation infrastructure like golden datasets and benchmarking tools, automating knowledge generation, optimizing AI agent accuracy with retrieval and prompt techniques, developing intelligence infrastructure for model upgrades and A/B testing, and driving volume automation across channels.

What is the team and company culture like at Assembled?

The Agent Intelligence team focuses on maximizing AI agent performance and driving volume automation across channels, and is one of the fastest growing areas. The company is backed by $70M from top investors, driven by experts passionate about problem-solving, and works with enterprise clients like Canva, Etsy, and Ramp on significant unsolved engineering challenges.

What makes a strong candidate for the Agent Performance Engineering role?

Strong candidates have experience building evaluation systems, knowledge automation, AI optimization tools, and scalable infrastructure for enterprise AI deployment, with a passion for solving complex problems in AI agent performance.

Assembled

Optimizes workforce management for customer support

About Assembled

Assembled optimizes workforce management for customer support teams by providing a platform that enhances the efficiency of service operations. The platform includes features like advanced scheduling, real-time monitoring, and data analytics, which help businesses manage their customer service more effectively. It serves a range of clients, from small businesses to large corporations, by using artificial intelligence and automation to improve team performance. Key features include adherence reports that track agent schedules and real-time performance data to maintain high service uptime. Assembled operates on a subscription-based model, allowing clients to access its tools for a recurring fee, which supports ongoing updates and improvements. The main goal of Assembled is to reduce operational costs, boost agent productivity, and enhance customer satisfaction by ensuring that support teams are optimally staffed and managed.

San Francisco, CaliforniaHeadquarters

2018Year Founded

$68.8MTotal Funding

SERIES_BCompany Stage

Enterprise Software, AI & Machine LearningIndustries

51-200Employees

Benefits

Competitive compensation and equity package

Insurance coverage

401(k)

CSA Credit

Stipend for use at any Assembled customer

Professional development stipend

Wellness stipend

Risks

Competition from CRM giants like Salesforce may threaten market share.

Rapid AI advancements require continuous innovation, straining resources.

Economic downturns could reduce client spending on workforce management tools.

Differentiation

Assembled offers AI-driven workforce management tailored for customer support teams.

The platform integrates seamlessly with tools like Google Calendar and Slack.

Assembled provides real-time data analytics for optimizing customer support operations.

Upsides

Raised $51M in Series B funding for product development and innovation.

Increased demand for remote work solutions aligns with Assembled's capabilities.

Growing need for omnichannel support enhances Assembled's market relevance.

Land your dream remote job 3x faster with AI

Try Jobo Free