Microsoft is looking to incubate disruptive technologies for its next-gen hardware products, specifically focusing on machine learning-powered experiences that transform the Windows experience.
Requirements
- 3+ years experience conducting research as part of a research program in academic or industry settings.
- 2+ years' experience training and/or finetuning large language models, model compression, distillation to small language models.
- 3+ years' experience with Python and deep learning libraries
- Experience in large language/multimodal model training, finetuning and distillation.
- Experience using dataset curation, data generation using prompting state of art LLMs and/or model alignment.
- Experience with reinforcement learning libraries or formal methods and verification is a plus.
Responsibilities
- Research focusing on foundation models - Designing and training language and multimodal models (and finetunes) with supervised finetuning, distillation, reinforcement learning, low-rank adaptation.
- Research focusing on environment interaction, policy specification and verification and human intent alignment.
- Implementation: Train, distill, and finetune language and vision models in PyTorch, DeepSpeed, AzureML stack.
- Machine learning engineering - Build pipelines to test designs, algorithms and models.
- Data science - Research and develop synthetic data generation strategies.
- Proactively follow state of the art research and share latest work, write papers, attend conferences and share knowledge in the wider team.
Other
- Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience
- Ability to meet Microsoft, customer and/or government security screening requirements are required for this role.
- Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
- Demonstrated ability and passion for incubating new ideas, solving problems, and building working systems.
- Equivalent experience.
