Microsoft is looking to transform how Copilot features are developed and evaluated by delivering an end-to-end experimentation, evaluation, and validation platform for Copilot engineers, PMs, and data scientists. This platform will orchestrate the offline evaluation lifecycle, including realistic data generation, data hydration, and injection, to empower Copilot teams to prototype safely and measure quality with scientific rigor, making Copilot innovation fast, reliable, and regression-free.
Requirements
- 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C-Sharp, Java, JavaScript, or Python
- 5+ years of experience owning and delivering large-scale projects involving multiple engineers.
- 2+ years working in AI or LLM based systems.
- 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C-Sharp, Java, JavaScript, or Python
- 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C-Sharp, Java, JavaScript, or Python
- Proven analytical mindset with a data-driven approach to problem-solving, consistently upholding high standards of quality and engineering rigor.
- Proven track record of independently owning and delivering technically challenging projects with measurable impact.
Responsibilities
- Lead platform development and scaling to customer requirements and apply best practices for meeting scaling needs and performance expectations and holds accountability for products that do not meet expectations.
- Architect and deliver a platform that is secure, scalable, and resilient.
- Lead technical strategy and execution across multiple teams and services.
- Champion the integration of AI to streamline development workflows, reinforce simplicity in design, improve test automation, and enhance system redundancy and scalability.
- Partner with PMs, architects, and other engineering leaders to define and deliver end-to-end solutions.
- Act as an expert and DRI (Designated Responsible Individual), be on call to mitigate system/product/service degradation to avoid downtime or interruptions.
- Define and track success metrics that reflect customer value.
Other
- Ability to meet Microsoft, customer and/or government security screening requirements are required for this role.
- This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
- Fast learner with a demonstrated ability to quickly master new technologies, tools, and domains.
- Self-motivated and outcomes-focused, with a strong sense of ownership and accountability.
- Microsoft will accept applications for the role until October 30, 2025.
