Ensuring safety for Google’s newest and most advanced AI products and designing insightful evaluation strategies for technologies where standard testing protocols do not yet exist or apply.
Requirements
4 years of experience in trust and safety, product policy, privacy and security, legal, compliance, risk management, intel, content moderation, red teaming, AI testing, adversarial testing, or similar.
1 year of experience in data analytics or research, business process analysis, or global program management, or leading cross-functional process improvements.
Experience using data to provide solutions and recommendations and working with multiple large datasets.
Understanding of AI systems, machine learning, and their potential risks.
Ability to think and identify emerging threats and vulnerabilities.
Responsibilities
Advise the evolution of AI testing by inventing and scaling novel evaluation methodologies and reusable frameworks, collaborating with engineering to enhance testing infrastructure.
Take ownership of end-to-end evaluations for pioneering GenAI products, translating safety policies into concrete test protocols.
Design sophisticated prompt strategies and conduct quantitative and qualitative analysis to identify systemic risks and provide insights for launch decisions.
Design insightful evaluation strategies for technologies where standard testing protocols do not yet exist or apply.
Own structured pre-launch safety, neutrality, and testing from end-to-end for Google's GenAI products.
Develop and scale testing methodologies, partnering with engineering teams to design the novel infrastructure and tools required to automate and scale.
Leveraging data analysis to provide insights on potential risks.
Other
Bachelor's degree or equivalent practical experience.
Be a subject matter expert, offer expert consultation, drive alignment across Trust and Safety teams, and lead strategic programs to improve the overall testing ecosystem and advance AI safety practices across the organization.
Manage multiple stakeholders through effective communication, and streamline processes.
Excellent problem-solving and critical thinking skills with attention to detail in an ever-changing environment
Excellent communication and presentation skills and the ability to influence cross-functionally at various levels.
