Inovalon is looking to solve healthcare's greatest needs by integrating advanced AI/ML capabilities into full-stack applications, focusing on agentic architectures, Large Language Models (LLMs), and Retrieval-Augmented Generation (RAG) to deliver secure, scalable, enterprise solutions.
Requirements
- Hands-on with LLM platforms: Gemini Enterprise, Microsoft Copilot; experience with OpenAI or Anthropic a plus;
- Agent frameworks and orchestration (e.g., LangChain/LCEL, Vertex AI Agents, Azure OpenAI orchestration, function/tool calling);
- RAG pipelines (document ingestion, text splitting, embeddings, retrieval strategies such as hybrid/BM25, re-ranking);
- Vector databases (e.g., BigQuery vector, Vertex Matching Engine, Azure Cognitive Search, Pinecone) and metadata schemas;
- Prompt engineering and safety guardrails (system prompts, tool descriptions, content filters, grounding, JSON outputs);
- 5+ years software development experience (Python, TypeScript/JavaScript, C or Java) with strong design/debug skills.
- Full-stack frameworks (e.g., React/Next.js, Angular, .NET, Spring) and REST/GraphQL API development.
Responsibilities
- Architect, develop, and maintain full-stack services and UIs that integrate LLMs, agents, and RAG pipelines;
- Design agentic solutions (planning, tool-use, memory) and orchestration for multi-step workflows;
- Operationalize Gemini Enterprise and Microsoft Copilot integrations, including identity, permissions, and governance;
- Implement secure data grounding with vector databases (embeddings, chunking, indexing) and guardrails;
- Build evaluation harnesses for AI quality (precision/recall, hallucination checks, safety filters) and telemetry;
- Own CI/CD for AI-enabled services, including automated tests (unit/integration), canary, and rollbacks;
- Conduct performance tuning and cost optimization for LLM usage (token budgeting, caching, prompt design);
Other
- Collaborate with product and stakeholders to scope, estimate, and prioritize AI features and platform capabilities;
- Document architecture, APIs, prompts, and operational runbooks; train and support partner teams;
- Participate in design/code reviews, retrospectives, and continuous improvement;
- Adhere to HIPAA, security, and responsible AI policies (privacy, explainability, monitoring, incident response);
- Participate in the on-call rotation to support critical issues.
