Guide product development, decisions and directions through principled evaluation and rigorous use of data for Siri's user facing products.
Requirements
- Experience in data science, machine learning, and analytics, including statistical data analysis and A/B testing.
- Experience articulating and translating business questions and using statistical techniques to arrive at an answer using available data.
- Strong programming skills, including data-querying skills (SQL and/or Spark, etc.) and experience with a scripting language for data processing and development (e.g., Python, R, or Scala).
- Hands-on experience with online AB testing platform.
- Experience designing, analyzing and interpreting experiments.
- Hands-on experience with on-device logging and metrics development.
- Experience with large language models, leveraging LLM for evaluation and product improvement.
Responsibilities
- Research and develop evaluation methods to improve the quality of Siri’s user facing products.
- Work with evaluation/experimentation engineering teams to get your methodological developments translated into technologies that Siri engineering will use every day.
- Work with large, complex data sets.
- Solve difficult, non-routine analysis problems, applying advanced analytical methods as needed.
- Conduct analysis that includes data gathering and requirements specification, processing, analysis, ongoing work, and presentations.
- Build and prototype analysis pipelines iteratively to provide insights at scale.
- Partner closely with Siri search engineering teams on core machine learning algorithms and systems that are part of Siri’s ability to understand and respond to requests.
Other
- 5 years of relevant work experience.
- B.S. in Machine Learning, Computer Science, Statistics, Operations Research or related areas.
- 8 years of relevant work experience.
- Ph.D. in machine learning, computer science, statistics, operations research or related areas.
- Passionate about building outstanding products.
