TELUS Digital is building a high-impact team of Machine Learning Expert Raters to work alongside Policy Enforcement specialists and provide actionable insights that shape AI decision-making.
Requirements
- 1+ year of experience with AI model supervised fine-tuning or reinforcement learning (RLHF).
- 1+ year of experience in Machine Learning operations (MLOps).
- 1+ year of experience in User-Generated Content (UGC) moderation or Trust & Safety operations.
- Strong skills in data analysis, pattern detection, and reporting.
- Ability to handle edge-case or ambiguous scenarios in AI training sets.
Responsibilities
- Evaluate and provide feedback on AI model outputs and reasoning (chain-of-thought) in nuanced Trust & Safety cases.
- Perform high-quality content annotations in partnership with Policy Experts.
- Support supervised fine-tuning and reinforcement learning (RLHF) processes.
- Conduct data analysis to identify patterns, trends, and model weaknesses.
- Produce clear reports and actionable insights for engineering and policy teams.
- Collaborate closely with policy enforcement teams to ensure ML models meet established guidelines.
- Maintain confidentiality and responsibly handle sensitive or challenging content.
Other
- Native-level English communication skills.
- Deep familiarity with U.S. culture and context, gained through U.S. citizenship or at least 5 years of residency.
- Detail-oriented with strong ability to follow complex workflows and guidelines.
