TELUS is seeking a Data Scientist to join their AI Rater Program to uncover insights from rater-generated data and improve AI-driven ad relevance and related projects.
Requirements
- Strong proficiency in Python, SQL and R
- Applied expertise in statistical modeling and experimental design (e.g., sampling, confidence intervals, agreement metrics).
- Experience working with moderate-to-large datasets, with ability to scale analyses as data volume grows.
- Familiarity with BI/visualization tools such as Looker Studio, Sisense, Tableau, or PowerBI.
- Experience in Google Cloud Platform (GCP) or other cloud data environments preferred.
- Experience with bias detection, NLP, or applied AI/ML models.
- Knowledge of rater evaluation methods and quality metrics such as Krippendorff’s alpha, chance-corrected agreement, or structured sampling.
Responsibilities
- Develop, implement, and maintain program and rater performance metrics (e.g., quality, bias, consistency, efficiency).
- Design and analyze experiments and statistical tests to uncover drivers of performance and label patterns.
- Build dashboards, reports, and automated monitoring systems in Looker Studio, Sisense, or similar BI tools.
- Identify and highlight potential biases or preferences in labeling data (e.g., topic-specific or cultural/linguistic bias).
- Collaborate with linguists, raters, and program managers to translate findings into operational and client-facing insights.
- Conduct applied analytics using Python, SQL, and statistical modeling, with opportunities to apply predictive modeling, NLP, and bias detection algorithms.
- Manage and explore datasets ranging from structured spreadsheets/CSVs to larger-scale rater outputs (scaling to millions of rows as needed).
Other
- English B2 - Required.
- 2 years in a quantitative role (Data Scientist, Product Analyst, or similar) with proven ability to navigate ambiguous environments.
- Master’s degree in Statistics, Mathematics, Computer Science, Economics, or a related field OR equivalent practical experience.
- Strong collaboration skills, with experience working in cross-functional teams (linguists, operations, engineering, client teams).
- Comfortable supporting client meetings as a subject-matter expert, while primarily focused on internal analysis and insights.
