Shape the way M365 measures AI by taking our evaluation system to the next level, allowing teams, partners, and customers to understand what "high quality" means for AI products. Accelerate learning by supporting all user journeys of an evaluation system with friendly, reliable, scalable, and well-documented tools.
Requirements
- coding in languages including, but not limited to, C, C++, C-Sharp, Java, JavaScript, or Python
- Experience building systems to evaluate and drive quality in a product and using data to drive engineering decisions.
- A passion for building reliable, scalable infrastructure and making your users successful.
- Platform engineering mindset: building reusable components, reducing time‑to‑launch, improving debuggability, and delivering well‑documented tooling.
- 5+ years of experience owning and delivering large-scale projects involving multiple engineers.
- Experience with AI/ML technologies.
Responsibilities
- Building reusable components that we can leverage across our evaluation stack
- Driving new capabilities in the platform that reduce the time to launch by allowing more capacity, speeding up the system, reducing the number of manual steps to launch, improving debuggability, etc…
- Provide technical leadership for the identification of dependencies and the development of design documents for a product, application, service, or platform.
- Lead by example and mentor others to produce extensible and maintainable code used across the company.
- Leverage deep subject-matter expertise of cross-product features with appropriate stakeholders (e.g., project managers) to lead multiple product's project plans, release plans, and work items.
- Hold accountability as a Designated Responsible Individual (DRI), mentoring engineers across products/solutions, working on-call to monitor system/product/service for degradation, downtime, or interruptions.
- Proactively seek new knowledge and adapt to new trends, technical solutions, and patterns that will improve the availability, reliability, efficiency, observability, and performance of products while also driving consistency in monitoring and operations at scale and share knowledge with other engineers.
Other
- Partner with appropriate stakeholders to determine user requirements for our evaluation scenarios
- Comfortable at operating in a dynamic environment; takes initiative to bring clarity and momentum.
- Self-motivated and outcomes-focused, with a sense of ownership and accountability.
- Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process
