At Client, we leverage large volumes of data and state-of-the-art machine learning techniques to understand what our 1B members read and write about on Client.com, and we are seeking AI Linguists to join our diverse and interdisciplinary team to focus on AI quality, evaluation, and annotation and to contribute with their expertise to the annotation/human judgment pipeline development that lay at the foundation of the Client AI model development and improvement.
Requirements
- Annotation
- Artificial Intelligence (AI)
- Data Analysis
- Documentation
- Python
- Training
- Experience with large-scale AI annotation and evaluation workflows
- Proficiency in Python for data analysis and tool development
- Experience with human judgment and AI training processes
- Previous experience with agentic products is a strong plus
- Experience with human judgment projects and flows
- Experience with complex and scalable data annotations and evaluations
- Experience with programming languages in data annotation space
Responsibilities
- Design and execute on solutions for AI quality, evaluation, and annotation
- Leverage Generative AI prompting, human input, hybrid approaches in the development of scalable and high-quality human judgment workflows
- Conduct data-driven analysis and provide linguistic insights for project development
- Be part of working groups that develop high-quality human judgment/annotation/evaluation pipelines
- Research new methodologies for process and product improvement
- Maximize productivity, process efficiency and quality through streamlined workflows, process standardization, documentation
- Perform continuous evaluations of the agentic products and report findings
Other
- 2+ years’ relevant industry experience
- 2+ years’ experience with large-scale, end-to-end human judgment flows and tools for the training/evaluation of AI models
- 2+ years’ experience to breakdown linguistic data requirements into concise, clear instructions and designs
- Required Education: Bachelor’s degree in Computational Linguistics, Language Technologies, Linguistics, Speech Science, or a related field
- Preferred Education: Master’s or Doctorate degree in Computational Linguistics, Language Technologies, Linguistics, or a related field
- Only those lawfully authorized to work in the designated country associated with the position will be considered
