Transforming mission-critical processes in the healthcare industry by architecting and scaling secure, reliable backend systems that power advanced Large Language Model (LLM) applications
Requirements
- 5+ years of backend or full-stack software engineering experience, with 3+ years working specifically on ML/LLM-enabled applications
- Strong coding skills in Python and ideally experience with one statically typed language (e.g., Go, Java, or TypeScript)
- Experience with LLM integration frameworks (e.g., Hugging Face, LangChain, LlamaIndex, or direct APIs from OpenAI/Anthropic)
- Deep knowledge of distributed systems, service-oriented architecture, and building APIs at scale
- Hands-on experience with cloud platforms (AWS/GCP/Azure), Kubernetes, Docker, and Terraform
- Excellent system design skills and familiarity with MLOps/LLMOps practices (CI/CD for models, evaluation, monitoring)
- Experience applying LLMs in healthcare or other regulated industries (e.g., familiarity with FHIR, HL7, HIPAA)
Responsibilities
- Architect and implement scalable, low-latency APIs and services that wrap, orchestrate, and optimize LLMs for high-volume healthcare use cases
- Build robust ingestion, preprocessing, and Retrieval-Augmented Generation (RAG) pipelines to ground LLMs in proprietary clinical and revenue-cycle data
- Design and implement systems for model monitoring, evaluation harnesses, cost tracking, and guardrails, ensuring reliability and responsible use in production
- Engineer solutions for caching, batching, load balancing, and scaling LLM workloads across cloud and containerized environments
- Implement HIPAA-ready infrastructure, robust data governance, and auditability for all LLM-powered applications in a regulated setting
- Drive end-to-end delivery of LLM backend projects, establish engineering best practices, and mentor peers in complex LLM system design
- Push LLMs beyond demos into mission-critical, cost-efficient, and secure production healthcare workflows
Other
- Must be available to work 4 days a week on-site in the Burlingame office
- Visa Sponsorship is available
- Unlimited PTO policy
- Comprehensive Benefits: Health, dental, and vision coverage, and 401(k) plan
- Equity Options as part of the total compensation package
