Job Board
LogoLogo

Get Jobs Tailored to Your Resume

Filtr uses AI to scan 1000+ jobs and finds postings that perfectly matches your resume

Outlier AI Logo

User Experience Rater (Remote)_

Outlier AI

From $15
Dec 18, 2025
Atlanta, GA, US
Apply Now

Outlier, owned and operated by Scale AI, is committed to improving the intelligence and safety of AI models by providing high-quality training data through expert human feedback. The goal is to enhance AI performance by ensuring the data it is trained on is of the highest quality.

Requirements

  • Analytical and Problem-Solving Skills: Ability to develop complex, professional-level prompts and evaluate nuanced AI reasoning.
  • Strong Writing: Clear, concise, and engaging writing to explain decisions or critique responses.
  • Attention to Detail: Commitment to accuracy and ability to assess technical aspects of model outputs.

Responsibilities

  • Adopt a 'user mindset' to produce natural data to meet the realistic needs you have or would use AI for.
  • Use the tool of rubrics to address user needs in a structured way.
  • Evaluate AI outputs by reviewing and ranking reasoning and problem-solving responses from large language models.
  • Contribute across projects depending on your specific skillset and experience.

Other

  • Education: Bachelor's degree or higher (or currently enrolled).
  • Fluent English speakers are required.
  • Flexible schedule and time commitment: No contracts, no 9-to-5. You control your schedule.
  • Most experts spend 5-10 hours/week, up to 40 hours working from home.
  • Willingness to join a global community of experts contributing to advanced AI tools.