The Trust & Safety team at Google is looking to solve the problem of identifying and mitigating abuse and fraud across Google's products, such as Search, Labs, and Assistant. This involves establishing metrics to benchmark Generative AI issues, developing datasets for evaluation, analyzing data to identify abuse trends, and improving operational workflows and tools to enhance user safety and trust.
Requirements
- 5 years of experience in data analysis, including identifying trends, generating summary statistics, and drawing insights from quantitative and qualitative data.
- 5 years of experience in managing projects and defining project scope, goals, and deliverables.
- 5 years of experience with SQL, R, Python, or C++.
- 5 years of experience with machine learning systems.
- Experience in using statistical analysis and hypothesis testing.
Responsibilities
- Help to establish metrics to benchmark Generative AI issues and quantify improvements.
- Develop datasets and run evaluations for engineers to evaluate and improve Search, Labs, and Assistant products.
- Perform data analysis to deliver insights that help identify and fight abuse across our products.
- Analyze and debug escalations and identify trends that can indicate bigger product risks.
- Enhance our operational workflows by process improvements and identification of automation opportunities.
- Improve tools through data analysis, technical expertise, and presentations to stakeholders.
- Enable the deployment of defenses to stop abuse and lead process improvement efforts to improve speed and quality of response to abuse.
Other
- Perform on-call responsibilities on a rotating basis, including weekend coverage.
- Work with sensitive content or situations which can be exposed to graphic, controversial, or upsetting topics or content.
- Excellent communication skills.
- Excellent problem-solving and thinking skills with attention to detail in a changing environment
- Trust & Safety team members are tasked with identifying and taking on the biggest problems that challenge the safety and integrity of our products.
