The Business and Industry Solutions (BIS) team at Microsoft is looking to drive innovation at the intersection of AI, experimentation, and enterprise systems by designing and evaluating autonomous agents that deliver measurable improvements in accuracy, latency, and cost-efficiency.
Requirements
- Prior expertise in natural language processing (NLP), with a strong foundation in large language model (LLM) development, evaluation, and fine-tuning.
- Hands-on experience in applying advanced fine-tuning techniques—including instruction tuning, reinforcement learning from human feedback (RLHF), and tool-augmented generation—to build agents capable of multi-step reasoning and decision-making.
- Familiarity with prompt engineering, context-aware orchestration, and integrating LLMs with external tools and APIs.
- Experience developing and deploying AI/ML products or systems at multiple points in the product cycle from ideation to shipping.
- 5+ years experience developing and deploying AI/ML products or systems at multiple points in the product cycle from ideation to shipping.
- Strong foundation in large language model (LLM) development, evaluation, and fine-tuning.
- Experience with reinforcement learning, instruction tuning, and tool-augmented generation.
Responsibilities
- Drive strategic impact by identifying and leading high-leverage data science and analytics initiatives across multiple product domains.
- Lead the development and deployment of advanced model fine-tuning pipelines, leveraging Reinforcement Learning from Human Feedback (RLHF) to align AI system behavior with human intent and improve performance in complex, real-world enterprise scenarios.
- Design and implement robust measurement systems, experimentation frameworks, and causal inference methodologies tailored to dynamic AI systems and enterprise-scale environments.
- Mentor and elevate the data science community by championing best practices, nurturing talent, and cultivating a collaborative, high-performance culture.
- Harness AI to accelerate workflows and amplify team productivity through intelligent automation and innovation.
- Lead rapid experimentation cycles, develop robust evaluation frameworks, and apply advanced techniques like reinforcement learning to enable multi-step reasoning and decision-making.
- Collaborate across engineering, product, and partner teams to ensure agents are performant, secure, reliable, and extensible—empowering customers and partners to build on our platform.
Other
- Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience.
- OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience.
- OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience.
- Ability to meet Microsoft, customer and/or government security screening requirements.
- This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
