Humana is seeking to improve care quality and experience of millions of consumers through AI innovation, specifically by developing robust and reusable AI modules and pipelines for effective risk management and measurement.
Requirements
- Proficiency in SQL, Python, and data analysis/data mining tools
- Experience with machine learning frameworks like Pytorch, JAX, LangChain, or LangGraph
- Experience with high performance, large-scale ML systems
- Experience with language modeling with transformers
- Experience designing human-centered evaluation protocols, metrics, and pipelines
- Experience with large-scale ETL
- Experience with +5 years of experience in applied ML, with at least 3+ in conversational AI, human-in-the-loop systems, or agent UX optimization
Responsibilities
- Develop and own ML pipelines for evaluating and improving human-AI interaction across modalities (text, speech, UI/UX feedback, behavioral signals)
- Design adaptive models for intent recognition, dialog state tracking, preference learning, and multi-turn personalization
- Lead human-in-the-loop data collection strategies and feedback integration to fine-tune agent behaviors
- Partner with UX, engineering, and safety teams to embed explainability, user control, and alignment into AI systems
- Develop and monitor human-centered evaluation metrics (e.g., helpfulness, latency, trust calibration, long-term engagement)
- Construct causal inference and A/B testing to assess impact of interaction strategies on behavior and outcomes
- Mentor a team of data scientists and collaborate with AI researchers and product leaders on foundational interaction improvements
Other
- Master's Degree and 4+ years of experience in research/ML engineering or an applied research scientist position preferably with a focus on developing production-ready AI solutions
- 2+ years of experience leading development of AI/ML systems
- Proven track record building production-grade AI models with strong UX and behavioral outcomes
- Strong communication skills with ability to bridge data science, product, and engineering
- Travel: While this is a remote position, occasional travel to Humana's offices for training or meetings may be required
