Software Engineer, Gen AI Platform at Abridge

San Francisco, California, United States

Apply Now

$162,000 – $234,000Compensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

HealthcareIndustries

Requirements

Experience building agent applications with tool-calling, context engineering, or open connector integrations
Fluency with LLM APIs, prompting strategies, and orchestration patterns (e.g., LangChain, LlamaIndex, or custom pipelines)
Experience with retrieval systems (e.g., semantic and lexical retrieval, vector DBs, efficient kNN), function calling, tool use, or agentic workflows
Strong coding skills in one or more of: Python, Java, Go. Comfortable with service design, APIs, and data models for high-throughput systems
Working knowledge of containers and kubernetes concepts. Familiarity with metrics, tracing, on-call rotations, and incident response practices
Self-motivated with a willingness to take ownership
Strong communication skills and ability to work collaboratively in a team environment

Responsibilities

Design and build GenAI systems that turn LLMs into composable, dependable tools—leveraging retrieval, tool use, agentic reasoning, and structured outputs
Design and implement a highly reliable and scalable agent runtime: orchestration, shared state and memory, tool-calling interfaces, and scheduling for cost, latency, and quality
Build secure, sandboxed execution for agent actions and code; optimize cold start, isolation, and observability
Ship unified interfaces for multiple model sizes and providers; integrate with open tool ecosystems such as MCP-style connectors for data and actions
Develop an evaluation platform for online and offline assessments, A/B tests, safety checks, and regression gates that improve agent reliability over time
Partner with Research to deliver new agent capabilities end to end—from prototype to production

Skills

GenAI

LLMs

Retrieval

Tool Use

Agentic Reasoning

Structured Outputs

Orchestration

Tool-Calling

Sandboxing

Observability

Abridge

AI platform for clinical documentation automation

About Abridge

Abridge provides a platform that changes how medical conversations are documented in healthcare settings. Its main product allows healthcare providers to record patient visits, which are then transformed into organized clinical documents. This helps doctors and other healthcare professionals save time on paperwork, allowing them to concentrate more on caring for their patients. Abridge stands out from its competitors by focusing specifically on the needs of healthcare providers, payers, and pharmaceutical companies, offering a solution that improves both documentation efficiency and patient outcomes. The goal of Abridge is to enhance the quality of patient care while making the documentation process easier for healthcare professionals.

Pittsburgh, PennsylvaniaHeadquarters

2018Year Founded

$201.8MTotal Funding

SERIES_CCompany Stage

AI & Machine Learning, HealthcareIndustries

51-200Employees

Benefits

Medical insurance

Dental Insurance

Vision Insurance

Unlimited Paid Time Off

Equity

Flexible Spending (FSA) & Health Savings (HSA) Accounts

Learning and Development budget

401k Plan

Paid Parental Leave

Flexible working hours

Home Office Budget

Sabbatical Leave

Risks

Rapid expansion may strain Abridge's resources and affect service quality.

Integration challenges with EHR systems could disrupt workflows and data consistency.

Data privacy concerns in AI applications may lead to regulatory scrutiny.

Differentiation

Abridge transforms medical conversations into actionable clinical documentation using AI.

The platform supports over 28 languages and 50+ medical specialties.

Abridge's integration with EMR systems enhances clinician efficiency and patient care.

Upsides

Abridge's partnership with Mayo Clinic expands its reach to over 1 million patients.

The $150 million Series C funding accelerates AI technology development and integration.

Abridge's multilingual capabilities improve communication in diverse patient populations.

Land your dream remote job 3x faster with AI

Try Jobo Free