Waymo is looking to develop machine learning solutions addressing open problems in autonomous driving, specifically focusing on building large-scale sensor data for training and evaluating LLM/VLM-based Foundation Models to improve the Waymo Driver's capabilities and safety.
Requirements
- Track record in building datasets for large-scale systems like VLMs and LLMs.
- Track record in developing reliable and high-quality data infrastructure for large-scale deep learning systems.
- Experience in large-scale data curation, data sampling, data mining, and/or data-model co-evolving.
- Experience in collaborating with horizontal teams, from model teams, infrastructure teams, and data teams, to advance key product success.
- Having first-hand experience as users of data for large-scale generalist deep learning models.
- Experience in large-scale distributed systems or products.
Responsibilities
- Build large-scale sensor data for training and evaluating LLM/VLM-based Foundation Models, with a special focus on scene and semantics understanding.
- Enable large-scale training and eval for LLM/VLM-based foundation models with high-quality, targeted sensor data.
- Create data strategies for Foundation Model Flywheel that advances our critical businesses: large-scale sensor data collection, business-driven sensor data sampling, long-tail data mining, large-scale auto-labeling, targeted efficient human labeling, human-in-the-loop sensor data curation and quality improving.
- Collaborate with foundation model owners to co-evolve our data and model components: using foundation models to auto-label large-scale driving data, and mining targeted long-tails to improve foundation models.
- Set up and evolve the working structure between multiple teams across Waymo, where we maximize reuse of infrastructure and tooling.
- Responsible for defining and delivering large-scale and high-quality sensor dataset for foundation model training and evaluation.
Other
- FULL-TIME
- Waymo employees are also eligible to participate in Waymo’s discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements.
