Roku is looking to scale its experimentation capabilities and improve its experimentation platform by exploring and implementing scalable and robust statistical methods. The goal is to build tooling for self-service experiments and establish best practices across the company.
Requirements
- Deep knowledge of statistics, probability, and machine learning techniques
- Hands-on experience on experimental design, A/B testing, causal inference, and statistical modeling/forecasting
- Expertise in SQL, SAS, R, Python, or other programming languages to query data and perform analysis
- Hands-on experience with visualization tools like Tableau or Looker
- Have a bias towards action in resolving issues and operate in a dynamic environment.
- A desire to question the status quo and promote innovative solutions to challenging problems.
Responsibilities
- Own the experimentation roadmap for Core Analytics in partnership with Product and Engineering.
- Define the standard for statistical analysis across varying types of experiments and units of analysis, ensuring robust results with minimal bias
- Lead the design, implementation, and analysis of sophisticated A/B tests and experiments, leveraging innovative techniques like Bayesian inference and causal methods to optimize complex strategies
- Develop necessary data pipelines to power automation, validation, and reporting
- Collaborate with stakeholders to align data science initiatives with organizational goals and strategy
- Collaborate with the Product Management and Engineering team to proactively seek and incorporate feedback
- Investigate and develop solutions to track, monitor, and improve our Experimentation ecosystem.
Other
- 2+ years of work experience with a PhD in a quantitative field (e.g., Computer Science, Mathematics, Physics, Data Science, etc.) OR 5+ years of equivalent practical experience with a master’s degree.
- The ability to effectively communicate with technical and non-technical business partners alike, who are interested in building strong cross-functional relationships.
- This is a hybrid role with four days per week in the office, Monday through Thursday.
- The selected candidate will be based out of San Jose, CA or NYC.
