Microsoft is looking to define the future of workplace search experiences for millions of enterprise users by advancing the quality of the search and retrieval stack for Copilot across workplace entity types.
Requirements
- 2+ years of experience working training/evaluating search/information retrieval systems as Product Manager, Software Developer, or Data Scientist.
- Experience with AI/ML systems and ability to translate the relationship of the AI/ML component to user behavior and user impact.
- Ability to define metrics that represent success for the customer or business, and evaluate feature impact and inform next steps.
- Experience with semantic search, RAG system optimization, LLM-mediated search, and evaluation frameworks.
- Experience with search, retrieval, and AI/ML technologies.
- Ability to integrate state-of-the-art technologies into Copilot’s search and retrieval architecture.
- Experience with data science and software development
Responsibilities
- Contribute to the technical vision for Copilot’s search and retrieval architecture, identifying and integrating state-of-the-art technologies (including semantic search, RAG system optimization, LLM-mediated search, and evaluation frameworks) to deliver best-in-class search quality.
- Continuously evaluate emerging trends in search, retrieval, and AI/ML, and champion their adoption into Copilot’s core systems.
- Develop and refine robust evaluation methodologies and metrics to assess search performance, relevance, and user satisfaction.
- Partner with engineering, data science, product management, and UX teams to identify opportunities, prioritize initiatives, and deliver impactful enhancements to Copilot’s search experience.
- Present technical strategies, results, and recommendations to stakeholders, driving alignment and continuous improvement across the organization.
- Drive Technology Adoption by influencing technical direction and search quality standards across modalities and content types.
- Design Evaluation Frameworks to leverage quantitative analysis and user feedback to guide improvements.
Other
- Bachelor's Degree AND 5+ years of experience in product/service/program management or software development
- Ability to collaborate across disciplines, time zones, feature teams, and partners
- Ability to communicate and influence stakeholders
- Travel up to 25%
- 0 days/week in-office, remote work
