Mercor is looking to solve the problem of evaluating and improving AI-generated responses for AI research labs by leveraging the expertise of Computer Science professionals.
Requirements
- Deep subject-matter expertise across core areas of computer science.
Responsibilities
- Create and assess complex problems in Computer Science across subdomains like algorithms, data structures, operating systems, computer architecture, databases, programming languages, and machine learning.
- Evaluate AI-generated responses for conceptual accuracy, technical rigor, and domain relevance.
- Provide clear written feedback on computer science problem sets, code solutions, and explanations.
- Collaborate asynchronously with AI researchers and engineers to iterate and improve model performance.
- Ensure technical accuracy and academic precision in all computer science content used to train or evaluate AI systems.
Other
- PhD in Computer Science or a directly related field from a top university.
- 2+ years of academic experience or professional experience.
- Exceptional written and verbal communication skills.
- Strong attention to detail and analytical thinking.
- Independent contractor
- Remote
- 1–2 months
- 20–40 hours/week
