Apple Services Engineering (ASE) is looking for a Manager in Responsible Development & Safety to shape policies and model and application evaluation processes to ensure the safe and responsible deployment of user-facing AI features across their services.
Requirements
- Proficiency in Python for data analysis (pandas, NumPy, Jupyter, etc.).
- Experience working with large datasets, annotation tools, or model-evaluation pipelines.
- Ability to design taxonomies, categorization schemes, or structured rating frameworks.
- Experience working directly with LLMs, LMMs, and generative AI and agentic systems, in a development and/or evaluation capacity.
- 5+ years experiences with AI evaluations, managed with a diverse sets of collaborators, such as Product, Engineering, Security, and Legal teams.
- Experience navigating and assessing complex societal questions related to technology development, including balancing the benefits and risks of research and applications.
- 5+ years proven experience with AI product and/or user policies in multiple regions of the world
Responsibilities
- Shape and support implementation of safety policies defined by AI Product teams.
- Collaborate with AIML, Product & Design, Privacy, Human-centered AI, policy leads, and business owners to define model and application evaluation requirements, set priorities, and scope and manage execution of AI /ML model and application evaluations.
- Work with Senior Managers to set objectives and key results and the long-term strategy for safety evaluation, including benchmarks, automated methods, and ongoing monitoring of safety performance of AI models.
- Develop new programming and generate opportunities for ASE to regularly engage with Policy, Legal, and Privacy teams.
- Develop and document standard processes through working with machine learning engineers and experts, and where appropriate, external organizations.
- Reviewing AI model performance, and providing guidance.
- Use your expertise in technology’s societal implications to improve the safety development ecosystem as a manager of a small team developing and conducting safety evaluations.
Other
- Lead a team of individual contributors.
- Strong management skills, including the ability to communicate effectively in tight turnaround times.
- Excellent experience collaborating with technical stakeholders and highly interdisciplinary teams.
- Strong communication skills, both written and verbal.
- Strong ability to stitch together qualitative and quantitative findings into actionable guidance.
