Guide product development, decisions and directions through principled evaluation and rigorous use of data for Apple's products and services.
Requirements
- Proficiency in data science, machine learning, and analytics, including statistical data analysis.
- Experience crafting, conducting, analyzing, and interpreting experiments and investigations, especially on data quality, evaluation and risk assessment.
- Strong programming skills, including data-querying skills (SQL and/or Spark, etc.) and experience with a scripting language for data processing and development (e.g., Python, R, or Scala).
- Experience articulating and translating business questions and using statistical techniques to arrive at an answer using available data.
- Strong communication skills and the ability to naturally explain difficult technical topics (especially causal topics) to everyone from data scientists to engineers to business partners.
- Prompt engineering and building LLMs as judges.
- Methods that address accuracy and variability in human annotation data.
Responsibilities
- Research and develop evaluation methods to improve the quality of Apple user facing products, such as Siri and Apple Intelligence.
- Work with evaluation/experimentation engineering teams to get your methodological developments translated into technologies that product engineering will use every day.
- Work with large, complex data sets.
- Solve difficult, non-routine analysis problems, applying advanced analytical methods as needed, including prompt engineering and building LLMs as judges.
- Conduct analysis that includes data collection and quality control, requirements specification, processing and presentations.
- Build and prototype analysis pipelines iteratively to provide insights at scale.
- Partner closely with product engineering teams on core machine learning algorithms and user experience evaluations.
Other
- 5 years of relevant work experience.
- Advanced degree in a quantitative field such as Statistics, Operational Research, Bioinformatics, Economics, Psychology, Computer Science, Sociology, Mathematics, Physics, or similar quantitative field.
- Proven ability to collaborate effectively across functions and work well within a team.
- Capable of driving projects of varying sizes and scopes - some will take months and some weeks - and you will need to know when to dive deep.
- Ability to learn new technology and skills to accommodate changing working requirements.
