Microsoft's CoreAI Platform team is looking to solve real, production-critical problems across Microsoft's AI systems by using AI/ML models, statistical modeling, and intelligent automation to detect anomalies, identify emerging patterns, and predict system behaviors before they impact customers. The goal is to drive reliability, performance, and efficiency across AI model-serving pipelines that power experiences like Copilot and Azure OpenAI Foundry models, ultimately increasing overall engineering velocity.
Requirements
- coding in languages including, but not limited to, C, C++, C-Sharp, Java, JavaScript, or Python
- 2+ years of experience in Python for AI automation
- 1+ year(s) of experience in AI to build solutions using toolchains and frameworks in Python, C++ and Kubernetes (K8s)
- 1+ year(s) of experience demonstrating a grasp of Large Language Model (LLM) post-training techniques, inference optimization, and application-layer use cases
- Familiarity with embeddings, semantic search, or LLMbased analysis used for system intelligence or reasoning.
- Familiarity with agentic frameworks (LangChain, Autogen, DSPy)
- Exposure to React or frontend observability dashboards is a plus
Responsibilities
- Design, build, and scale AI models to detect anomalies, identify regressions across large-scale AI systems.
- Analyze patterns in telemetry, logs, and real‑time signals to uncover root causes, predict failures, and drive proactive mitigations.
- Apply AI to identify emerging usage trends, performance hotspots, and workload irregularities that impact system health and user experience.
- Build lightweight automation that leverages anomaly detection signals and pattern analysis to improve live‑site reliability and engineering velocity.
- Contribute to hotfixes, performance tuning, and reliability improvements in production AI engines (e.g., GPU savings, SLA reliability, customer satisfaction).
- Build intuitive, responsive UI components for AI dashboards and telemetry tools using React and modern web technologies.
Other
- Ability to meet Microsoft, customer and/or government security screening requirements are required for this role.
- Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
- Communicate technical concepts with clarity and initiative, proactively seeking feedback and driving continuous improvement.
- Stay current with industry trends in applied AI, observability, and performance engineering.
- Persuasive communication and collaboration abilities; comfortable working in ambiguous, fast-moving environments.
