Roblox is looking to solve the problem of maintaining a positive, engaging, and trustworthy platform experience for its global community by detecting and mitigating harmful user-generated content and violative on-platform behaviors.
Requirements
- 10+ years of industry experience in data science, economics, analytics, or machine learning engineering
- 7+ years of experience using scripting languages (Python, R), and big data query/processing languages and tools such as SQL, Hive, Spark, and Airflow
- Knowledge of ML and Deep Learning either via formal training or industry experience
- Ability to apply creative first-principles reasoning to solve ambiguous problems
- Experience developing large-scale safety or moderation systems as well as experience with content platforms, specifically user-generated content
- Advanced Degree and/or PhD in Statistics, Computer Science, Physics, Applied Math, Economics, or other related quantitative fields
Responsibilities
- Establish and monitor robust prevalence measurement methodologies to accurately quantify the overall level of harmful content and behavior on the platform, providing the authoritative source of truth for organizational safety goals.
- Develop and validate comprehensive ground truth datasets for harmful UGC and violative on-platform behaviors, ensuring high quality and alignment with the latest platform policies.
- Deepen our understanding of violations by conducting exploratory analysis on current and emerging threat landscapes, providing data-backed recommendations on where Product and Engineering should strategically invest detection and moderation resources.
- Design, implement, and analyze sophisticated experiments for new moderation and safety enforcement features, communicating results to our primary partners in Product and Engineering to guide development, while also collaborating closely with Policy, Compliance, and Legal teams for full strategic alignment.
- Leverage advanced causal inference methodologies to accurately measure the effectiveness and potential systemic impacts of various safety initiatives on player experience and platform integrity.
- Communicate strategic insights and present recommendations to leadership and all cross-functional partners, translating complex statistical findings on prevalence, ground truth quality, and effectiveness into actionable strategies for Product, Engineering, Policy, Compliance, and Legal.
- Partner with ML and Data Engineering teams to ensure model development, reporting, and detection systems are built on statistically sound ground truth and measurement frameworks.
Other
- 10+ years of industry experience
- Advanced Degree and/or PhD in a related field
- Ability to communicate strategic insights and present recommendations to leadership and cross-functional partners
- Collaboration with Product, Engineering, Policy, Compliance, and Legal teams
- Optional presence on Monday and Friday, with onsite presence required on Tuesday, Wednesday, and Thursday
