Waymo is undergoing unprecedented growth, rapidly expanding into new cities and launching new vehicle platforms. The Software Quality Operations (SWQOPS) team, especially Technical Specialists, plays a critical role in this expansion, making it possible to scale safely and efficiently by ensuring the safety, reliability, and quality of the Waymo Driver.
Requirements
- Increased competency in supporting all phases of the machine learning development lifecycle, from data preparation and training to validation, deployment, and continuous monitoring.
- Experience with ML testing and validation, including dataset quality assurance, bias detection, edge-case scenario testing, and performance evaluation using statistical metrics.
- Ability to quickly learn and implement new concepts and utilize proprietary tools.
- Strong understanding of driving rules and regulations.
- Basic SQL querying.
- Competency in LLM / transformer models, and / or ML for robotics domain experience.
Responsibilities
- Partner with Engineering to design, test, and deploy cutting-edge Machine Learning (ML) and Generative AI (Gen-AI) models and tools to drive step-change improvements in issue discovery & detection, triage efficiency, and quality assurance.
- Leverage AI-powered insights and traditional triage signals to proactively identify emerging on-road issue trends, new risk scenarios, and edge cases.
- Develop and refine data-driven strategies for issue discovery and monitoring, enhanced by ML model outputs
- Design and implement robust quality control processes for both human and AI-generated outputs.
- Perform meta-quality checks, validate the integrity of vendor work, and provide feedback to improve both human and model performance.
- Provide technical leadership and consultation to stakeholders to enhance our workflows and quality.
- Be the trusted source for creating and updating technical policies, guidelines, and standard operating procedures for new scopes, platforms, and driving signals
Other
- Serve as the key link between AI/ML development and operational execution.
- Define and document new policies, guidelines, and Standard Operating Procedures (SOPs) that integrate AI tools and insights into daily vendor workflows.
- Act as the subject matter expert for our Software Quality Operations, working closely with stakeholders, program leads, and vendor teams to ensure seamless adoption and maximum impact of AI/ML advancements in our quality processes.
- A proven ability to work in a fast-paced, high-stress environment while maintaining good judgment.
- Excellent communication and interpersonal skills to effectively collaborate with a wide range of individuals in a diverse and dynamic work environment.
