Develop and deliver robust, natural and scalable speech technologies, across a rich set of scenarios and languages for Microsoft's Azure AI services by developing innovative tools and metrics for comprehensive evaluation.
Requirements
- 3+ years of experience in one or more of the following areas: speech recognition, large language models, machine learning, deep learning, pattern recognition, statistics.
- 2+ years of programming experience in Python with PyTorch.
- 1+ years of experience in developing and deploying products or systems at multiple points in the product cycle from ideation to shipping.
- 1+ years of experience in AI benchmarking, such as LLM, speech, computer vision, machine translation, and so on.
- 2+ years of experience in publication on top speech and machine learning conferences, such as ICASSP, InterSpeech, ASRU, ICML, ICLR, NeuroIPS, etc.
Responsibilities
- Innovate and develop novel benchmarking metrics to advance state-of-the-art speech technologies for real world user scenarios.
- Develop metrics highly correlated to human experience for model quality.
- Develop experimentation systems to assess system performance.
- Collaborate with engineering team to scale offline and online measurement system.
- Utilize diverse feedback channels (e.g., A/B testing, flight experiments, and log analysis) to assess the performance and reliability of speech systems in dynamic environments.
- Stay updated with the latest trends in speech technologies, large language models (LLM), and evaluation techniques, and apply knowledge to ongoing projects.
Other
- Ability to meet Microsoft, customer and/or government security screening requirements are required for this role.
- Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
- Applied Sciences IC4
- The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year.
- There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $158,400 - $258,000 per year.
