Software Engineer - AI Infrastructure at Assembled

New York, New York, United States

Apply Now

$135,000 – $280,000Compensation

Mid-level (3 to 4 years), Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

Technology, AI, Customer SupportIndustries

Requirements

6+ years of engineering experience, with past ownership of high-scale, production-critical infrastructure
Experience with distributed systems and container orchestration (especially Kubernetes)
Experience with AI/ML platforms or excitement to build foundational infrastructure for LLM-based applications
Thrive in fast-paced environments with shifting requirements and ambiguous problem spaces
Motivated by impact, enjoy deep technical challenges, and want to work cross-functionally across security, AI, and product
Strong familiarity with one or more parts of the tech stack: Cloud provider (AWS), Orchestration (Kubernetes + Karpenter), LLM integration (OpenAI, Anthropic, or open-source model serving e.g., vLLM, HuggingFace TGI, Ray Serve), Prompt & embedding infrastructure (Vec)

Responsibilities

Build and operate core systems that power Assist, the AI agent platform for customer support, ensuring it is fast, reliable, and secure
Manage and scale infrastructure for serving LLM-powered agents across chat, email, and voice, including selecting inference strategies, integrating with model providers (e.g., OpenAI, Anthropic), and dynamically routing traffic for performance and cost efficiency
Own highly-available, fast-access storage and indexing layers for dynamically generated prompts and semantic search across support content, optimized for real-time AI interactions
Build systems for privacy and security, including network-level intrusion detection (IDS/IPS), audit logging, and LLM usage policy enforcement
Operate observability and usage analytics systems to surface key metrics like token usage, latency, cost per response, and quality signals
Explore and evangelize AI-powered developer tools to accelerate internal engineering workflows, such as internal chat agents, pair programming tools, and intelligent automation for deployment, debugging, and on-call

Skills

Key technologies and capabilities for this role

LLMAI InfrastructureInference StrategiesModel ProvidersReal-time SystemsScalingReliability EngineeringSecurityAI AgentsChatEmailVoice

Questions & Answers

Common questions about this position

What is the salary range for the Software Engineer - AI Infrastructure role?

The salary range is $135K - $280K.

Is this a remote position or does it require office work?

This information is not specified in the job description.

What skills are required for this software engineer role?

The role requires experience in building and operating core infrastructure systems, scaling LLM-powered services, integrating with model providers like OpenAI and Anthropic, and working on storage systems, security, and observability.

What is the company culture like at Assembled?

Assembled has a team of experts passionate about problem-solving, with a highly cross-functional Infrastructure team that works closely with AI, security, and product engineering teams in a high-ownership environment focused on 0-to-1 building.

What makes a strong candidate for this AI Infrastructure Engineer position?

Strong candidates are excited by 0-to-1 building, shaping AI product infrastructure, and have experience with high-ownership roles in scaling systems for real-time LLM usage, security, and reliability.

Assembled

Optimizes workforce management for customer support

About Assembled

Assembled optimizes workforce management for customer support teams by providing a platform that enhances the efficiency of service operations. The platform includes features like advanced scheduling, real-time monitoring, and data analytics, which help businesses manage their customer service more effectively. It serves a range of clients, from small businesses to large corporations, by using artificial intelligence and automation to improve team performance. Key features include adherence reports that track agent schedules and real-time performance data to maintain high service uptime. Assembled operates on a subscription-based model, allowing clients to access its tools for a recurring fee, which supports ongoing updates and improvements. The main goal of Assembled is to reduce operational costs, boost agent productivity, and enhance customer satisfaction by ensuring that support teams are optimally staffed and managed.

San Francisco, CaliforniaHeadquarters

2018Year Founded

$68.8MTotal Funding

SERIES_BCompany Stage

Enterprise Software, AI & Machine LearningIndustries

51-200Employees

Benefits

Competitive compensation and equity package

Insurance coverage

401(k)

CSA Credit

Stipend for use at any Assembled customer

Professional development stipend

Wellness stipend

Risks

Competition from CRM giants like Salesforce may threaten market share.

Rapid AI advancements require continuous innovation, straining resources.

Economic downturns could reduce client spending on workforce management tools.

Differentiation

Assembled offers AI-driven workforce management tailored for customer support teams.

The platform integrates seamlessly with tools like Google Calendar and Slack.

Assembled provides real-time data analytics for optimizing customer support operations.

Upsides

Raised $51M in Series B funding for product development and innovation.

Increased demand for remote work solutions aligns with Assembled's capabilities.

Growing need for omnichannel support enhances Assembled's market relevance.

Land your dream remote job 3x faster with AI

Try Jobo Free