The company is looking to apply data science skills at the intersection of healthcare, AI ethics, and regulatory compliance, likely to ensure responsible AI development and deployment within the healthcare sector.
Requirements
- 5+ years of experience with the full ML system development, deployment, and maintenance lifecycle
- 5+ years of experience working with advanced NLP models and methodologies
- 5+ years of experience with python and ML frameworks (e.g., scikit-learn, Pandas, Numpy)
- Deep understanding of ethical considerations and fairness in AI model development
- Experience working with large language models or conversational AI systems
- Familiarity with prompt engineering and adversarial testing methodologies
- Basic understanding of information security principles
Responsibilities
- Design, and develop job aids and guidance documentation for best practices of responsible AI.
- Develop Python scripts to automate testing processes and analyze results.
- Help identify vulnerabilities related to PII/PHI exposure in AI interactions
- Maintain test data sets and contribute to improving testing methodologies
- Stay abreast of the latest developments in AI/ML research and incorporate relevant findings into work
- Assist in designing and executing Red Team testing scenarios for conversational AI systems
Other
- Clearly communicate with diverse teams including legal, compliance, and AI development over a wide variety of AI methods including Generative AI and traditional ML.
- Document findings, create reports, and present results to stakeholders.
- Provide mentorship and guidance to colleagues, fostering a culture of continuous learning and improvement
- BS degree plus 5+ years equivalent experience in computer science, applied mathematics, applied statistics, or similar quantitative fields of study
- Familiarity with healthcare systems including claims payment, call centers, or claims-based research.
