Develop new agentive AI experiences in Copilot, including training agentive LLM capabilities, evaluating LLMs, and creating new user-facing features.
Requirements
- Experience prompting, evaluating, and working with large language models.
- Experience writing production-quality Python code.
- 4 years of data science experience (e.g., managing structured and unstructured data, applying machine learning techniques and driving product direction).
- Experience with Reinforcement Learning data, fine tuning, or training classifiers or engineering prompts.
- Doctorate in Computer Science, Machine Learning, Human-Centered AI or related field AND 2 year(s) experience (e.g., finetuning models with supervision or reinforcement learning, understanding and fixing data quality and curation, working with collaborators on creating new products).
- Master's Degree in Computer Science, Machine Learning, or related field AND 5 years experience (e.g., managing structured and unstructured data, developing and debugging models, creating infrastructure for AI-powered products).
- Bachelor's Degree in Computer Science, Mathematics, Machine Learning, Physics, or related field AND 7 years data-science experience (e.g., managing structured and unstructured data, applying machine learning techniques and driving product direction).
Responsibilities
- Leverage subject matter expertise to improve model quality for interactive and agentive experiences in consumer Copilot.
- Oversee data acquisition or generation efforts, ensuring that the data meets product needs.
- Generalize machine learning (ML) solutions into repeatable frameworks.
- Lead evaluation efforts of models deployed within Copilot.
- Track advances in industry and academia, identifies relevant state-of-the-art research, and adapts algorithms and/or techniques to drive innovation and develop new solutions.
- Independently write efficient, readable, extensible code and model pipelines.
- Contribute to defining the model quality roadmap for Copilot, keeping in mind business and product goals.
Other
- effective communicator and great teammate.
- takes the initiative, is user-centered and enjoys building world-class consumer experiences and products in a fast-paced environment.
- By applying to this U.S. Mountain View, CA position or Redmond, WA, you are required to be local to the San Francisco area OR Redmond, WA area and in office 3 days a week.
- Commit to a customer-oriented focus by acknowledging customer needs and perspectives, and building AI products that delight customers.
- Starting January 26, 2026, MAI employees are expected to work from a designated Microsoft office at least four days a week if they live within 50 miles (U.S.) or 25 miles (non-U.S., country-specific) of that location.
