Outlier, owned and operated by Scale AI, is committed to improving the intelligence and safety of AI models by providing high-quality data for LLMs. They work with contributors globally to provide expert human feedback, which leads to AI advancements for top AI labs and large language model builders.
Requirements
- Analytical and Problem-Solving Skills: Ability to develop complex, professional-level prompts and evaluate nuanced AI reasoning.
- Strong Writing: Clear, concise, and engaging writing to explain decisions or critique responses.
- Attention to Detail: Commitment to accuracy and ability to assess technical aspects of model outputs.
Responsibilities
- Adopt a 'user mindset' to produce natural data to meet the realistic needs you have or would use AI for.
- Use the tool of rubrics to address user needs in a structured way.
- Evaluate AI outputs by reviewing and ranking reasoning and problem-solving responses from large language models.
- Contribute across projects depending on your specific skillset and experience.
Other
- Education: Bachelor's degree or higher (or currently enrolled).
- Fluent English speaker.
- Flexible schedule and time commitment: No contracts, no 9-to-5. You control your schedule.
- Ability to work remotely.
- Interest or background in AI, machine learning, or creative tech tools (Nice to Have).