The Options Clearing Corporation (OCC) is looking to enhance its audit function's capabilities, particularly in the realm of AI systems and related infrastructure, by leveraging data analytics and AI techniques. The goal is to proactively identify key audit risks, improve audit methodologies, and support management in achieving strategic objectives.
Requirements
- Familiarity with one or more scripting tools such as: Python, SQL, R
- Familiarity with analytical tools such as: Tableau, Alteryx, Pandas
- Familiarity with testing, documentation and versioning tools (e.g., pyTest, Github, pyDoc or similar)
- Understanding of AI/ML concepts, including prompt engineering, model evaluation, and responsible AI principles
- Proficiency in writing effective AI prompts to extract meaningful insights from data
- Understanding of AI infrastructure requirements and security considerations
- Experience with Retrieval Augmented Generation (RAG) and large language model implementations
Responsibilities
- Support the Internal Audit Department on feasibility analysis and delivery of assigned audits using advanced data analytics and AI-assisted techniques
- Evaluate data quality issues and identify potential exceptions or inefficient practices, proposing achievable solutions
- Support the Internal Audit Department, both audit engagement and internal data analytics teams, on feasibility analysis and the delivery of assigned audits using data analytics
- Assess the design and operating effectiveness of controls around AI systems, machine learning models, and related infrastructure
- Apply risk-based analytics to identify potential audit areas and/or samples
- Create and refine AI prompts to enhance audit procedures and testing methodologies
- Educate audit teams on AI concepts, risks, and appropriate audit approaches
Other
- Ability to communicate clearly and effectively, both orally and in writing, including the ability to handle potentially sensitive situations and discussions
- Strong problem solving and analytical capabilities
- Demonstrated ability to gather, analyze, and evaluate facts, and prepare and present concise oral and written reports
- Ability to work independently or as part of a team, prioritizing multiple audit assignments to simultaneously complete each in a timely fashion
- THIS POSITION IS NOT ELIGIBLE FOR VISA SPONSORSHIP
