The AI Non-Model Risk Review Team within Model Risk Management (MRM) at Citi is seeking a Senior Validator to manage model risk associated with AI Non-Model Objects, with a strong emphasis on Generative AI, across Citi's diverse lines of business.
Requirements
- Experience in AI/ML model development, validation, or implementation, with a strong focus on Natural Language Processing (NLP).
- Hands-on experience with Generative AI models, including development, implementation, Retrieval-Augmented Generation (RAG), and prompt engineering, is highly desirable.
- Advanced programming skills in Python, with proficiency in data analysis, interpretation, and visualization.
- Deep understanding of model risk management frameworks and regulatory requirements, with the ability to apply these principles effectively in practice.
- Demonstrated ability to learn and apply new techniques in AI/ML, particularly in Generative AI and NLP.
Responsibilities
- Manage a portfolio of Generative AI and Natural Language Processing (NLP) models, with a focus on operational efficiency and process automation.
- Perform model validations, annual reviews, ongoing monitoring, model limitation remediation, and supervisory/peer reviews for the assigned portfolio.
- Evaluate both technical and functional aspects of Generative AI and NLP models, including model assumptions, conceptual soundness, mathematical formulation, calibration, and performance.
- Assess the functional application of these models for regulatory and business purposes.
- Conduct in-depth reviews of model development documentation, identify shortcomings, execute validation tests, and communicate findings to senior stakeholders.
- Prepare comprehensive validation reports and manage model risk on an ongoing basis.
- Conduct research on emerging techniques in Generative AI, NLP, and machine learning to ensure the team remains at the forefront of innovation.
Other
- This is an individual contributor role.
- Present validation findings and recommendations to senior management and other stakeholders, ensuring clear communication of complex technical concepts to non-technical audiences.
- Collaborate with cross-functional teams to develop and implement Generative AI solutions, driving innovation and operational excellence.
- Contribute to the development of Generative AI Use Cases for Model Risk Management.
- Proven ability to manage multiple projects simultaneously, demonstrating strong organizational and project management skills.
- Strong communication skills, with the ability to articulate complex technical findings to non-technical stakeholders and senior management in a clear and concise manner.
