Microsoft's Path team is looking to solve the business and technical problem of enhancing collaborative work management products like Microsoft Project, Planner, To Do, Whiteboard, and Visio by leveraging large language models (LLMs) and Agentic artificial intelligence (AI) to create "The Future of Work" and deliver value to customers.
Requirements
- Experience taking a user-facing product, feature, or experience to market (e.g., design, addressing product market fit, and launch, internal tool/framework).
- Experience navigating ambiguity across teams and balancing competing priorities, and problem-solving to consistently deliver defined outcomes.
Responsibilities
- Drive feature development by defining and delivering AI-powered capabilities that enhance collaboration and productivity within Planner.
- Translate user needs into AI-first feature requirements, working closely with design, engineering, and research to build intuitive, context-aware product experiences.
- Design and iterate on prompts, grounding strategies, and agent behaviors to ensure responses are accurate, relevant, and aligned with user intent.
- Lead evaluations of agent performance using both qualitative and quantitative methods including human-in-the-loop testing, prompt evaluation, grounding validation, and telemetry analysis.
- Collaborate with Applied Science to align on model capabilities, data needs, and evaluation frameworks, ensuring features are technically feasible and scalable.
- Partner with PMs across other product groups within M365 to ensure feature alignment and integration within the broader ecosystem.
- Define success metrics for agent features and drive continuous improvement through experimentation, A/B testing, and user feedback.
Other
- 3 days / week in-office
- Travel 0-25%
- Ability to meet Microsoft, customer and/or government security screening requirements are required for this role.
- This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
- Embody the Microsoft culture and values.
