Job Board
LogoLogo

Get Jobs Tailored to Your Resume

Filtr uses AI to scan 1000+ jobs and finds postings that perfectly matches your resume

Microsoft Power Platform Community Logo

Principal Applied Scientist, Agent Observability (CoreAI)

Microsoft Power Platform Community

$139,900 - $304,200
Nov 16, 2025
Redmond, WA, United States of America
Apply Now

The Foundry Agent Platform organization within Azure AI Platform is looking to build the next generation of AI-driven solutions that power Microsoft’s most innovative products and services, specifically focusing on developing advanced tools and platforms to monitor, evaluate, optimize and self-improve AI agent performance.

Requirements

  • 3+ years of experience developing and deploying AI/ML products or systems at multiple points in the product cycle from ideation to shipping
  • Experience with Agent based architectures, frameworks and technologies (such as MCP, A2A protocol, Langchain, Azure AI Foundry)
  • 5+ years experience creating publications (e.g., patents, libraries, peer-reviewed academic papers).
  • 2+ years experience presenting at conferences or other events in the outside research/industry community as an invited speaker.
  • 5+ years experience conducting research as part of a research program (in academic or industry settings).
  • 3+ years experience developing and deploying products or systems at multiple points in the product cycle from ideation to shipping

Responsibilities

  • Understand latest scientific advancements and collaborate with leading researchers to incubate cutting-edge RL techniques into the Foundry Agent Platform
  • Push the envelope on agent evaluation and experimentation, advancing the state-of-the-art by connecting customer needs, latest science techniques and product opportunities
  • Collaborate closely with backend engineers, data scientists, site reliability engineers (SREs), and product managers to gather requirements, iterate on features, and deliver seamless, end-to-end user experiences.
  • Collaborate closely with designers, UI-experts and engineers to ensure clear, actionable dashboards and visualizations that empower users to make trustworthy science-informed decisions.
  • Help to shape the direction of Agent Foundry Platform and Agent self-improvement with industry-leading product work
  • Bring new technology and approaches, such as Reinforcement Learning from Human Feedback (RLHF), into production by applying long-term research efforts to drive Agent self-improvement
  • Leverage and/or construct data and experimentation to rapidly iterate on and refine product opportunities in a rapidly evolving domain

Other

  • Bachelor's Degree in Statistics, Econometrics, Compute Science, Electrical or Computer Engineering, or related field AND 6+ years of related experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role.
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
  • Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience
  • Ability to work in a collaborative environment