Microsoft aims to develop AI software that enables running AI models across various platforms, from supercomputers to IoT devices. The Artificial Intelligence Frameworks team focuses on improving inference performance of OpenAI and other state-of-the-art LLM models, working directly with OpenAI on the Azure OpenAI service to support major Microsoft products with trillions of inferences per day.
Requirements
- Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C-Sharp, Java, JavaScript, or Python OR equivalent experience.
- Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C-Sharp, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C-Sharp, Java, JavaScript, or Python OR equivalent experience.
- PhD Degree in Computer Science or related technical field AND 1+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C-Sharp, Java, JavaScript.
- 1+ year of experience with Large Language Models (LLMS) and large scale execution on AI workloads.
- 3+ years of technical design, problem solving, and debugging skills.
Responsibilities
- Software development in C++, Python, and other languages for specialized accelerators and host systems.
- Software design, development and optimization to execute AI workloads at the cloud scale
- Co-design with hardware partner teams on HW/SW interfaces.
- Design and code review of peer work.
- Lead benchmarking and optimization of state-of-the-art LLMs across GPUs and Microsoft’s custom AI hardware
- Architect improvements to large-scale serving pipelines
- Diagnose complex performance bottlenecks across distributed systems
Other
- Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:
- Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
- Bachelor's Degree in Computer Science or related technical field
