The Siri team is developing groundbreaking technology to build a conversational agent that is helpful, knowledgeable, and can get things done naturally and intelligently, while upholding Apple's quality standards.
Requirements
- Experience with Machine Learning model development and evaluation
- Excellent understanding of an ML-based product lifecycle
- Expertise in generative AI technology, large language models (LLMs)
- Depth of knowledge and application of statistics-based evaluation methodologies or user success metrics
- Experience with full-stack development of ML-based software on consumer devices
- Experience with systems engineering; in-depth understanding of interdependencies of ML and SW components
- Experience with technical presentations for multiple audiences, including executives
Responsibilities
- Define model evaluation strategy and determine and develop appropriate methodologies to improve model accuracy
- Deliver offline evaluation insights that drive model development and user experience improvements
- Develop representative datasets, build realistic simulation environments, and develop scalable end-to-end evaluation pipelines
- Develop innovative evaluation solutions that are grounded in representative personal contexts
- Cultivate relationships with stakeholders across Siri and Apple to adopt state-of-the-art approaches to model evaluation
- Foster a culture of continuous improvement and data-driven decision-making across Siri teams
- Drive the strategy and technical design for ML systems evaluation
Other
- 10+ years of technical leadership experience
- Proven and consistent track record of forming senior partnerships to solve complex technical problems at scale
- Ability to develop a long-term vision and execute strategies at scale while maintaining a grasp of technical details for better decision-making
- MS/PhD in Machine Learning, Computer Science, or equivalent experience in a related field
- Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services
