Apply data science skills at the intersection of healthcare, AI ethics, and regulatory compliance.
Requirements
- 5+ years of experience with the full ML system development, deployment, and maintenance lifecycle
- 5+ years of experience working with advanced NLP models and methodologies
- 5+ years of experience with python and ML frameworks (e.g., scikit-learn, Pandas, Numpy)
- Deep understanding of ethical considerations and fairness in AI model development
- Experience working with large language models or conversational AI systems
- Familiarity with prompt engineering and adversarial testing methodologies
- Basic understanding of information security principles
Responsibilities
- Design, and develop job aids and guidance documentation for best practices of responsible AI.
- Develop Python scripts to automate testing processes and analyze results.
- Help identify vulnerabilities related to PII/PHI exposure in AI interactions
- Maintain test data sets and contribute to improving testing methodologies
- Stay abreast of the latest developments in AI/ML research and incorporate relevant findings into work
- Assist in designing and executing Red Team testing scenarios for conversational AI systems
Other
- Clearly communicate with diverse teams including legal, compliance, and AI development over a wide variety of AI methods including Generative AI and traditional ML.
- Document findings, create reports, and present results to stakeholders.
- Provide mentorship and guidance to colleagues, fostering a culture of continuous learning and improvement
- Familiarity with healthcare systems including claims payment, call centers, or claims-based research.
- Proven ability to translate business needs and requirements into technical solutions
