Software Engineer, Gen AI Platform at Abridge

San Francisco, California, United States

Apply Now

$162,000 – $234,000Compensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

HealthcareIndustries

Requirements

Experience building agent applications with tool-calling, context engineering, or open connector integrations
Fluency with LLM APIs, prompting strategies, and orchestration patterns (e.g., LangChain, LlamaIndex, or custom pipelines)
Experience with retrieval systems (e.g., semantic and lexical retrieval, vector DBs, efficient kNN), function calling, tool use, or agentic workflows
Strong coding skills in one or more of: Python, Java, Go. Comfortable with service design, APIs, and data models for high-throughput systems
Working knowledge of containers and kubernetes concepts. Familiarity with metrics, tracing, on-call rotations, and incident response practices
Self-motivated with a willingness to take ownership
Strong communication skills and ability to work collaboratively in a team environment

Responsibilities

Design and build GenAI systems that turn LLMs into composable, dependable tools—leveraging retrieval, tool use, agentic reasoning, and structured outputs
Design and implement a highly reliable and scalable agent runtime: orchestration, shared state and memory, tool-calling interfaces, and scheduling for cost, latency, and quality
Build secure, sandboxed execution for agent actions and code; optimize cold start, isolation, and observability
Ship unified interfaces for multiple model sizes and providers; integrate with open tool ecosystems such as MCP-style connectors for data and actions
Develop an evaluation platform for online and offline assessments, A/B tests, safety checks, and regression gates that improve agent reliability over time
Partner with Research to deliver new agent capabilities end to end—from prototype to production

Skills

Key technologies and capabilities for this role

GenAILLMsRetrievalTool UseAgentic ReasoningStructured OutputsOrchestrationTool-CallingSandboxingObservability

Questions & Answers

Common questions about this position

What is the salary range for this Software Engineer position?

The salary range is $162K - $234K.

Is this role remote or hybrid, and where are the offices located?

The position is hybrid. Offices are located in the Mission District in San Francisco, the SoHo neighborhood of New York, and East Liberty in Pittsburgh.

What skills and experience are required for this role?

Required experience includes building agent applications with tool-calling, context engineering, or open connector integrations; fluency with LLM APIs, prompting strategies, and orchestration patterns like LangChain or LlamaIndex; experience with retrieval systems, function calling, or agentic workflows; strong coding skills in Python, Java, or Go; and working knowledge of containers and Kubernetes concepts.

What is the team like at Abridge?

You will collaborate closely with a cross-functional team of researchers, clinical scientists, and product engineers. The company is a growing team of practicing MDs, AI scientists, PhDs, creatives, technologists, and engineers.

What makes a strong candidate for this Software Engineer role?

Strong candidates have experience building agent applications, fluency in LLM APIs and orchestration patterns like LangChain, expertise in retrieval systems and agentic workflows, strong coding skills in Python, Java, or Go, and knowledge of containers and Kubernetes.

Abridge

AI platform for clinical documentation automation

About Abridge

Abridge provides a platform that changes how medical conversations are documented in healthcare settings. Its main product allows healthcare providers to record patient visits, which are then transformed into organized clinical documents. This helps doctors and other healthcare professionals save time on paperwork, allowing them to concentrate more on caring for their patients. Abridge stands out from its competitors by focusing specifically on the needs of healthcare providers, payers, and pharmaceutical companies, offering a solution that improves both documentation efficiency and patient outcomes. The goal of Abridge is to enhance the quality of patient care while making the documentation process easier for healthcare professionals.

Pittsburgh, PennsylvaniaHeadquarters

2018Year Founded

$201.8MTotal Funding

SERIES_CCompany Stage

AI & Machine Learning, HealthcareIndustries

51-200Employees

Benefits

Medical insurance

Dental Insurance

Vision Insurance

Unlimited Paid Time Off

Equity

Flexible Spending (FSA) & Health Savings (HSA) Accounts

Learning and Development budget

401k Plan

Paid Parental Leave

Flexible working hours

Home Office Budget

Sabbatical Leave

Risks

Rapid expansion may strain Abridge's resources and affect service quality.

Integration challenges with EHR systems could disrupt workflows and data consistency.

Data privacy concerns in AI applications may lead to regulatory scrutiny.

Differentiation

Abridge transforms medical conversations into actionable clinical documentation using AI.

The platform supports over 28 languages and 50+ medical specialties.

Abridge's integration with EMR systems enhances clinician efficiency and patient care.

Upsides

Abridge's partnership with Mayo Clinic expands its reach to over 1 million patients.

The $150 million Series C funding accelerates AI technology development and integration.

Abridge's multilingual capabilities improve communication in diverse patient populations.

Land your dream remote job 3x faster with AI

Try Jobo Free