Prolific is seeking to advance the field of AI through innovative research in key areas including evaluation methodologies, alignment techniques, and synthetic data generation.
Requirements
- Deep knowledge of LLM evaluation methodologies, alignment techniques, and model optimization approaches
- Experience with model fine-tuning, adapters, quantization, and distillation frameworks
- Strong engineering fundamentals and experience implementing AI systems in production environments
- Demonstrated research experience through publications, open-source contributions, or impactful projects
- Experience with AI/ML engineering
- Knowledge of current challenges in AI safety, reliability, and alignment
- Experience with scalable frameworks for systematic evaluation of model behaviours and capabilities
Responsibilities
- Lead independent research projects in AI evaluation methodologies, alignment techniques, and synthetic data generation
- Design and implement novel evaluation frameworks for LLMs and agent systems that are grounded in human data
- Design and conduct rigorous experiments to study AI models and systems with sound methodological approaches
- Develop scalable frameworks for systematic evaluation of model behaviours and capabilities
- Create tools and frameworks that transform research insights into practical applications
- Build infrastructure to support large-scale research experiments when needed
- Apply knowledge of model fine-tuning, optimization techniques, distillation, and other ML engineering practices to support research goals
Other
- 5+ years of engineering experience
- Self-motivation and ability to define and pursue research directions independently
- Excellent understanding of current challenges in AI safety, reliability, and alignment
- Strong communication skills and ability to explain complex research concepts clearly
- Passion for staying current with the rapidly evolving AI research landscape
- Ability to work closely with ML engineers, data scientists, and product teams
- Ability to mentor team members on advanced AI concepts and emerging research directions
