Microsoft Copilot is focused on building the best AI-powered products in the world. The role aims to bridge the gap between ML's potential and its messy reality in production by building infrastructure that accelerates model improvement and drives continuous learning from production.
Requirements
- Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C-Sharp, Java, JavaScript, or Python OR equivalent experience.
- Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C-Sharp, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C-Sharp, Java, JavaScript, or Python OR equivalent experience.
- Familiarity with LLM deployment patterns, vector databases, prompt management, and the unique challenges of serving foundation models
- Experience working with RAG, fine-tuning pipelines, or evaluation frameworks
- The ability to see beyond individual components to design holistic systems where data flows naturally from production through improvement cycles and back
Responsibilities
- Training pipelines that scale elegantly - Design and implement robust training infrastructure that handles everything from data ingestion to model versioning, making it trivial for ML engineers to experiment and deploy with confidence
- The data flywheel - Build the infrastructure and product features that capture user interactions, ground truth labels, and edge cases, then automatically route them back into training loops. Turn every production interaction into a training example
- Inference systems that deliver - Dive deep into model serving architecture—optimize latency, manage costs, implement intelligent caching, and build the observability needed to maintain reliability at scale
- Deployment pipelines with guardrails - Create deployment systems that balance velocity with safety: automated testing, gradual rollouts, performance monitoring, and quick rollback mechanisms
- Cross-functional infrastructure - Partner closely with ML engineers, platform engineers, and data scientists to build APIs and tools that enable tight, rapid feedback loops from production back to model development
Other
- Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience
- Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience
- Starting January 26, 2026, MAI employees are expected to work from a designated Microsoft office at least four days a week if they live within 50 miles (U.S.) or 25 miles (non-U.S., country-specific) of that location
- Desire and preference to work at the intersection of teams, translating between ML researchers who want flexibility and engineers who need reliability
- Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances
