One of our clients, a research organization, is conducting a study on the quality, originality, and methodological rigor of contemporary machine learning research and needs an AI Subject Matter Expert to evaluate academic papers and provide structured technical assessments.
Requirements
- PhD or equivalent advanced experience in artificial intelligence, machine learning, or a related technical field.
- Experience reviewing or authoring ML research papers.
- Ability to interpret Python code and experimental workflows.
- Familiarity with academic literature review practices and tools.
- Strong analytical skills and attention to detail.
- Doctoral candidates and industry researchers with relevant expertise are welcome.
Responsibilities
- Review machine learning research papers for methodological soundness, clarity, and originality.
- Inspect Python code, experiment logs, and reported metrics for consistency and validity.
- Conduct literature reviews using academic search tools to assess novelty and prior art.
- Identify potential ethical, safety, or reproducibility concerns.
- Provide structured written feedback aligned with evaluation guidelines.
- Submit limited, non-identifying professional background information (e.g., degree level, affiliation, publication links) to support evaluator credibility.
Other
- Independent contractor engagement.
- Compensation paid based on completed work via Mercor’s platform.
- Flexible, short-term project timeline.
- PhD or equivalent advanced experience
- Doctoral candidates and industry researchers with relevant expertise are welcome.
