Waymo is experiencing unprecedented growth, rapidly expanding into new cities and launching new vehicle platforms. The Software Quality Operations (SWQOPS) team is critical to this expansion, enabling Waymo to scale safely and efficiently by ensuring the safety, reliability, and quality of the Waymo Driver. The team needs to build an adaptable and scalable operation, increasingly powered by AI, to deliver crucial insights necessary to confidently deploy and grow Waymo's autonomous vehicle service.
Requirements
- Increased competency in supporting all phases of the machine learning development lifecycle, from data preparation and training to validation, deployment, and continuous monitoring.
- Experience with ML testing and validation, including dataset quality assurance, bias detection, edge-case scenario testing, and performance evaluation using statistical metrics.
- Ability to quickly learn and implement new concepts and utilize proprietary tools.
- Basic SQL querying.
- Competency in LLM / transformer models, and / or ML for robotics domain experience.
Responsibilities
- Partner with Engineering to design, test, and deploy cutting-edge Machine Learning (ML) and Generative AI (Gen-AI) models and tools to drive step-change improvements in issue discovery & detection, triage efficiency, and quality assurance.
- Leverage AI-powered insights and traditional triage signals to proactively identify emerging on-road issue trends, new risk scenarios, and edge cases.
- Develop and refine data-driven strategies for issue discovery and monitoring, enhanced by ML model outputs
- Define and document new policies, guidelines, and Standard Operating Procedures (SOPs) that integrate AI tools and insights into daily vendor workflows.
- Design and implement robust quality control processes for both human and AI-generated outputs.
- Perform meta-quality checks, validate the integrity of vendor work, and provide feedback to improve both human and model performance.
- Provide technical leadership and consultation to stakeholders to enhance our workflows and quality.
Other
- BS/BA degree or 4 years of relevant work experience in AV Software Quality Operations
- Strong understanding of driving rules and regulations.
- A proven ability to work in a fast-paced, high-stress environment while maintaining good judgment.
- Excellent communication and interpersonal skills to effectively collaborate with a wide range of individuals in a diverse and dynamic work environment.
- Demonstrated strong execution with ability to drive outcomes.
