Canva is seeking a Research Engineer to build foundational datasets and systems that fuel next-generation generative AI models and evaluation capabilities to empower the world to design.
Requirements
- Strong proficiency in Python and ML frameworks (e.g., PyTorch, TensorFlow).
- Extensive experience with designing and implementing large-scale data processing workflows using libraries like Pandas and data warehousing solutions such as Snowflake.
- Solid understanding of statistical methods, including experimental design, A/B testing, and quality evaluation systems.
- Experience with generative AI and synthetic data generation is highly desirable.
- Experience with cloud platforms (e.g., AWS, GCP, Azure) for data storage, processing, and MLOps related to dataset management.
- Experience with MLOps practices and tools specifically for data versioning, lineage, and pipeline automation.
Responsibilities
- Design and build scalable pipelines for processing and curating large datasets of human design feedback.
- Research and develop ML models to generate high-quality synthetic data for training and fine-tuning.
- Own the design and implementation of human evaluation workflows, including creating guidelines and quality rubrics.
- Prepare datasets for automated evaluation systems and conduct deep analysis of their outputs to provide robust signals on model performance and human alignment.
- Design and analyze experiments to measure the real-world impact of our models on design quality.
- Conduct deep-dive analyses into model performance to identify failure modes and guide future development.
Other
- A strong aesthetic sense, with a background or demonstrated passion for visual design or human-computer interaction.
- 401(k) retirement plan with company contribution
- Inclusive parental leave policy that supports all parents & carers
- Annual Vibe & Thrive allowance to support your wellbeing, social connection, office setup & more
- Flexible leave options that empower you to be a force for good, take time to recharge and supports you personally
