Inovalon is looking to empower its customers with data-driven solutions to improve healthcare outcomes and economics by leveraging advanced AI/ML capabilities, including Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG), to deliver secure, scalable, enterprise solutions.
Requirements
- Hands-on with LLM platforms: Gemini Enterprise, Microsoft Copilot; experience with OpenAI or Anthropic a plus;
- Agent frameworks and orchestration (e.g., LangChain/LCEL, Vertex AI Agents, Azure OpenAI orchestration, function/tool calling);
- RAG pipelines (document ingestion, text splitting, embeddings, retrieval strategies such as hybrid/BM25, re-ranking);
- Vector databases (e.g., BigQuery vector, Vertex Matching Engine, Azure Cognitive Search, Pinecone) and metadata schemas;
- Prompt engineering and safety guardrails (system prompts, tool descriptions, content filters, grounding, JSON outputs);
- Evaluation & observability (prompt/unit tests, offline eval sets, A/B, tracing, metrics for accuracy, latency, cost);
- MLOps for LLMs (model/version management, feature stores, secrets, key rotation, quota management);
Responsibilities
- Architect, develop, and maintain full-stack services and UIs that integrate LLMs, agents, and RAG pipelines;
- Design agentic solutions (planning, tool-use, memory) and orchestration for multi-step workflows;
- Operationalize Gemini Enterprise and Microsoft Copilot integrations, including identity, permissions, and governance;
- Implement secure data grounding with vector databases (embeddings, chunking, indexing) and guardrails;
- Build evaluation harnesses for AI quality (precision/recall, hallucination checks, safety filters) and telemetry;
- Own CI/CD for AI-enabled services, including automated tests (unit/integration), canary, and rollbacks;
- Conduct performance tuning and cost optimization for LLM usage (token budgeting, caching, prompt design);
Other
- BS/BA in Computer Science, Software Engineering, or related field; MS/PhD preferred.
- Experience delivering AI-enabled features in production, at enterprise scale.
- Strong communication and collaboration skills with a growth mindset.
- Certifications a plus: AWS Certified Developer, Google Cloud (Vertex AI/Gemini), Microsoft (Azure AI/AI-900), PMP/CBAP for project leadership.
- Applicants must be authorized to work in the United States as a condition of employment.
