Outlier, owned and operated by Scale AI, is looking to improve the intelligence and safety of AI models by providing high-quality data for large language models (LLMs) through expert human feedback.
Requirements
- Ability to develop complex, professional-level prompts and evaluate nuanced AI reasoning.
- Strong writing skills to explain decisions or critique responses.
- Attention to detail and commitment to accuracy to assess technical aspects of model outputs.
- Experience in fields like literature, creative writing, history, philosophy, theology, etc. (nice to have)
- Prior writing or editorial experience (content strategist, technical writer, editor, etc.) (nice to have)
- Interest or background in AI, machine learning, or creative tech tools (nice to have)
Responsibilities
- Adopt a 'user mindset' to produce natural data to meet the realistic needs you have or would use AI for.
- Use the tool of rubrics to address user needs in a structured way.
- Evaluate AI outputs by reviewing and ranking reasoning and problem-solving responses from large language models.
- Contribute across projects depending on your specific skillset and experience.
Other
- Education: Bachelor's degree or higher (or currently enrolled).
- Analytical and problem-solving skills.
- Strong writing skills.
- Attention to detail and commitment to accuracy.
- Flexible schedule and time commitment (most experts spend 5-10 hours/week, up to 40 hours working from home)
