The Multimedia Generation team needs to evaluate AI multimedia generation products for images and videos, ensuring offline metrics predict online user engagement.
Requirements
- 1-2 years of basic Python knowledge particularly in working with image/video data and JSON.
- Experience in SQL and handling large data tables.
- Experience in the image and video domain.
- Ability to adapt to new code.
- Basic shell script knowledge
Responsibilities
- Set up Halo tasks and run model inference.
- Enqueue new queues to Halo, Audit annotations from vendors.
- Build necessary tooling for managing evaluation datasets.
- Collaborate with model development teams to conduct offline evaluations and automate pipelines.
- Facilitate set up queues manage image radio data and audit results.
- Ensure consistency and accuracy in measurements involving programming and auditing tasks
- Connect offline metrics with online user behavior
Other
- Bachelors preferred not required
- Flexibility in working hours.
- Experience as a GenAI user in the image and video domain.
- The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.
