Google is looking to solve complex modeling and evaluation challenges for large foundational models, specifically improving multi-turn, factuality, and search capabilities for Gemini.
Requirements
- 5 years of experience with software development in one or more programming languages.
- 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture.
- Experience with LLM training and generative models.
- Experience using Python libraries and frameworks.
- Experience with data structures/algorithms.
- Expertise in machine learning and reinforcement learning.
- Publications in machine learning conferences such as NeurIPS, ICML, ICLR, TACL, ACL, NAACL, EMNLP, COLM
Responsibilities
- Scope and drive research efforts to improve complex frontier Gemini capabilities, such as multi-turn, factuality and tool-use.
- Review the latest literature to guide research and experimental directions.
- Curate and generate data to evaluate and improve Gemini capabilities. Design and implement both human and automated evaluation strategies.
- Design and conduct supervised fine-tuning and reinforcement learning experiments to improve the performance of Gemini capabilities such as multi-turn and factuality.
- Collaborate with partners and product functions to deliver new model capabilities to production.
- Research new approaches for analyzing, evaluating and training LLMs to enhance their multi-turn capabilities.
- Devising innovative solutions for complex modeling and evaluation challenges in a fast-moving environment
Other
- Bachelor’s degree or equivalent practical experience.
- Master's degree or PhD in Computer Science or related technical field.
- 1 year of experience in a technical leadership role.
- Ability to work in a fast-paced environment and adapt to new problems
- Must be willing to present work regularly to both the team and executive stakeholders
