Outlier is committed to improving the intelligence & safety of AI models. Owned and operated by Scale AI, we’ve recently been for partnering experts with top AI labs to provide the high quality data for LLMs. We believe AI can only perform as well as the data it’s trained on. That’s why we work with contributors from all over the world, who help improve AI models by providing expert human feedback. This data has led to AI advancements for the world's leading AI labs and large language model builders.
Requirements
- Ability to develop complex, professional-level prompts and evaluate nuanced AI reasoning.
- Clear, concise, and engaging writing to explain decisions or critique responses.
- Commitment to accuracy and ability to assess technical aspects of model outputs.
- Interest or background in AI, machine learning, or creative tech tools.
Responsibilities
- Adopt a “user mindset” to produce naturaldata to meet the realistic needsyou have or would use AI for.
- Use the tool of rubrics to address user needs in a structured way.
- Evaluate AI outputs by reviewing and ranking reasoning and problem-solving responses from large language models.
- Contribute across projects depending on your specific skillset and experience.
Other
- Associates degree or higher (or currently enrolled).
- Native English speakers
- Ability to read, write and evaluate text fluently in English.
- Strong Writing
- Attention to Detail
