The Business and Industry Solutions (BIS) team at Microsoft is looking to shape the future of the autonomous enterprise and lead the development of intelligent, agent-first experiences that transform how businesses operate
Requirements
- Prior expertise in natural language processing (NLP), with a strong foundation in large language model (LLM) development, evaluation, and fine-tuning
- Hands-on experience in applying advanced fine-tuning techniques—including instruction tuning, reinforcement learning from human feedback (RLHF), and tool-augmented generation
- Familiarity with prompt/context engineering, context-aware orchestration, and integrating LLMs with external tools and APIs
- Experience developing and deploying AI/ML products or systems at multiple points in the product cycle from ideation to shipping
- 5+ years experience developing and deploying AI/ML products or systems
- Strong foundation in statistics, predictive analytics, or related field
- Experience with reinforcement learning, experimentation, and evaluation methodologies
Responsibilities
- Design and evaluate autonomous agents that deliver measurable improvements in accuracy, latency, and cost-efficiency
- Lead rapid experimentation cycles, develop robust evaluation frameworks, and apply advanced techniques like reinforcement learning to enable multi-step reasoning and decision-making
- Collaborate across engineering, product, and partner teams to ensure agents are performant, secure, reliable, and extensible
- Drive strategic impact by identifying and leading high-leverage data science and analytics initiatives across multiple product domains
- Lead the development and deployment of advanced model fine-tuning pipelines, leveraging Reinforcement Learning from Human Feedback (RLHF) to align AI system behavior with human intent and improve performance in complex, real-world enterprise scenarios
- Design and implement robust measurement systems, experimentation frameworks, and causal inference methodologies tailored to dynamic AI systems and enterprise-scale environments
- Harness AI to accelerate workflows and amplify team productivity through intelligent automation and innovation
Other
- Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience
- Ability to meet Microsoft, customer and/or government security screening requirements
- Ability to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
- Strong communication and collaboration skills
- Ability to work in a fast-paced, experimentation-driven environment
