Google is looking to create RoboRating capabilities with existing Large Language Models (LLMs) that produce reliable, reproducible ratings for real-world tasks, including search result rating, search quality rating, Ad rating, and more, to improve the next generation of advertising system for users and advertisers.
Requirements
- 5 years of experience with distributed Machine Learning and Machine Learning infrastructure, distributed systems and with Machine Learning algorithms at scale.
- Experience with applied computer vision or Machine Learning research and development, and supporting infrastructure.
- Experience with Large Language Models (LLMs)
- PhD degree in Computer Science, Artificial Intelligence, Machine Learning, or a related technical field, or equivalent practical experience.
- Experience in Machine Learning, or research achievements in the field of AI (e.g., product ownership, publications)
Responsibilities
- Understand current academic literature on LLM models' capabilities, and research on autorating (through LLMs, and otherwise), user simulation, and evaluation.
- Understand the current system, and the needs for rating and simulation tasks in the Google Ads context.
- Build and deliver functioning systems to Google Ads, with the goal to improve the next generation of advertising system, for the user, the advertiser, while keeping in mind Google's serving constraints and systems.
Other
- Bachelor's degree in Computer Science or equivalent practical experience.
- Google is proud to be an equal opportunity workplace and is an affirmative action employer.
- We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status.
- We also consider qualified applicants regardless of criminal histories, consistent with legal requirements.
- If you have a disability or special need that requires accommodation, please let us know by completing our Accommodations for Applicants form.
