Microsoft's Enterprise customers need tools to build agentic experiences over public and private knowledge, and the Azure AI Knowledge team is leading the way to deliver the next chapter of RAG (retrieval-augmented generation) to bring together many sources of data and transform data into knowledge.
Requirements
- 2+ years of experience coding in Python, C, Java or C++
- 2+ years of experience with large language models
- Experience developing task specific metrics and evaluation datasets
- Experience developing and deploying live production systems as part of a product team
Responsibilities
- Developing LLM prompts, agents and query execution workflows, often with tight latency constraints
- Collection, generation and filtering of training and evaluation data
- Building off state of the art techniques from across Microsoft and the industry
- Incorporate state of the art research into techniques shipped to production
- Develop and build metrics to use across the full range of search engine components
- Seek out and incorporate customer feedback into dataset construction, evaluation and technique development
- Provide technical excellence and contribute to experimentation infrastructure and proofs-of-concept to test out new ideas and concepts
Other
- Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 2+ years related experience
- Ability to meet Microsoft, customer and/or government security screening requirements
- Excellent hybrid work skills – clear synchronous and asynchronous communication, strong teamwork and collaboration skills
- Customer focused, strategic, drives for results, is self-motivated, and has a propensity for action
- Problem solver: ability to solve problems that the world has not solved before
