Outlier, owned and operated by Scale AI, is committed to improving the intelligence and safety of AI models by providing high-quality data for LLMs. They work with contributors worldwide to provide expert human feedback, which leads to AI advancements for top AI labs and large language model builders.
Requirements
- Ability to develop complex, professional-level prompts and evaluate nuanced AI reasoning.
- Clear, concise, and engaging writing to explain decisions or critique responses.
- Commitment to accuracy and ability to assess technical aspects of model outputs.
Responsibilities
- Adopt a user mindset to produce natural data to meet the realistic needs you have or would use AI for.
- Use the tool of rubrics to address user needs in a structured way.
- Evaluate AI outputs by reviewing and ranking reasoning and problem-solving responses from large language models.
- Contribute across projects depending on your specific skillset and experience.
Other
- Education: Bachelor's degree or higher (or currently enrolled).
- Fluent English speakers only.
- Flexible schedule with no contracts or 9-to-5 requirements.
- Most experts spend 5-10 hours/week, up to 40 hours working from home.
- For non-core work, such as during initial project onboarding or project overtime phases, lower rates may apply.
