Job Board
LogoLogo

Get Jobs Tailored to Your Resume

Filtr uses AI to scan 1000+ jobs and finds postings that perfectly matches your resume

Abridge Logo

Software Engineer, Gen AI Platform

Abridge

Salary not specified
Oct 7, 2025
San Francisco, CA, USA
Apply Now

Abridge's AI-powered platform aims to improve clinical documentation efficiencies and enable clinicians to focus on patient care by transforming patient-clinician conversations into structured clinical notes in real-time.

Requirements

  • Experience building agent applications with tool-calling, context engineering, or open connector integrations.
  • Fluency with LLM APIs, prompting strategies, and orchestration patterns (e.g., LangChain, LlamaIndex, or custom pipelines).
  • Experience with retrieval systems (e.g., semantic and lexical retrieval, vector DBs, efficient kNN), function calling, tool use, or agentic workflows.
  • Strong coding skills in one or more of: Python, Java, Go. Comfortable with service design, APIs, and data models for high-throughput systems.
  • Working knowledge of containers and kubernetes concepts.
  • Familiarity with metrics, tracing, on-call rotations, and incident response practices.
  • Prior work on agent orchestration pipelines: task routing, planning, memory graphs, vector search, or browser automation.
  • Experience with evaluations, preference optimization, or RL to improve LLM reliability.

Responsibilities

  • Design and build GenAI systems that turn LLMs into composable, dependable tools—leveraging retrieval, tool use, agentic reasoning, and structured outputs.
  • Design and implement a highly reliable and scalable agent runtime: orchestration, shared state and memory, tool-calling interfaces, and scheduling for cost, latency, and quality.
  • Build secure, sandboxed execution for agent actions and code; optimize cold start, isolation, and observability.
  • Ship unified interfaces for multiple model sizes and providers; integrate with open tool ecosystems such as MCP-styleconnectors for data and actions.
  • Develop an evaluation platform for online and offline assessments, A/B tests, safety checks, and regression gates that improve agent reliability over time.
  • Partner with Research to deliver new agent capabilities end to end—from prototype to production.

Other

  • Self-motivated with a willingness to take ownership.
  • Strong communication skills and ability to work collaboratively in a team environment.
  • Extreme ownership—every employee has the ability to (and is expected to) make an impact on our customers and our business.
  • Flexible work hours.
  • Inclusive culture.