Outlier, owned and operated by Scale AI, is committed to improving the intelligence and safety of AI models by providing high-quality data for large language models (LLMs). The job aims to address the challenge of training AI systems using expert human feedback to enhance AI performance.
Requirements
- Analytical and Problem-Solving Skills: Ability to develop complex, professional-level prompts and evaluate nuanced AI reasoning.
- Strong Writing: Clear, concise, and engaging writing to explain decisions or critique responses.
- Attention to Detail: Commitment to accuracy and ability to assess technical aspects of model outputs.
Responsibilities
- Adopt a 'user mindset' to produce natural data to meet the realistic needs you have or would use AI for.
- Use the tool of rubrics to address user needs in a structured way.
- Evaluate AI outputs by reviewing and ranking reasoning and problem-solving responses from large language models.
- Contribute across projects depending on your specific skillset and experience.
Other
- Education: Bachelor's degree or higher (or currently enrolled).
- Fluent English speaker.
- Flexible schedule and time commitment: No contracts, no 9-to-5. You control your schedule.
- Ability to work remotely from home.
- Willingness to participate in initial project onboarding or project overtime phases, which may involve lower rates.
