To develop new evaluation methodologies and carry out user research that powers the development and validation of generative AI systems at Apple Services Engineering (ASE)
Requirements
- PhD in a behavioral or social science field, human-computer interaction, statistics, engineering, computer science, or a related field
- 3+ years of experience in industry or a comparable applied research setting
- Strong background in conducting rigorous behavioral research
- Experience in one or more programming languages used for data processing and statistics (e.g., Python, R, SQL, etc.)
- 7+ years of experience in industry or a comparable applied research setting
- Prior research experience in human-centered evaluation or development of artificial intelligence or machine learning systems
- Data science experience, especially with large, distributed data frameworks (e.g., Spark, Hadoop, etc.)
Responsibilities
- Design and execute rigorous empirical studies using diverse methods (e.g., surveys, longitudinal designs, ecological momentary assessments, analysis of large-scale behavioral data) to investigate user experience with AI
- Innovate, develop, and validate novel methodologies for human-centered evaluation of generative AI models and systems
- Apply rigorous measurement principles and powerful statistical methods to ensure the validity and reliability of your findings
- Lead sophisticated research projects from inception to completion, coordinating cross-functional collaboration effectively
- Translate complex data findings into actionable insights and compelling recommendations for collaborators at all levels
Other
- Ability to communicate complex research findings clearly and persuasively to diverse audiences (technical and non-technical)
- Strong collaboration and communication skills
- Organized, highly attentive to detail, and manages time well
- Collaborate with researchers specializing in benchmarking, automated evaluation, synthetic data, data science, and responsible AI
- Mentor junior researchers and support the growth of the research organization
