Iron Systems, Inc. is seeking a Software Engineer II to evaluate AI-driven multimedia generation products (images and videos) to ensure their performance aligns with user engagement metrics. This involves connecting offline metrics with online user behavior for GenAI projects.
Requirements
- 1-2 years of experience with Python programming, especially with image/video data handling and JSON
- Proficiency in SQL and managing large datasets
- Experience working within the image and video domain
- Basic knowledge of shell scripting
- Ability to quickly adapt to new codebases and tools
Responsibilities
- Set up Halo tasks and execute model inference processes
- Enqueue new queues within Halo and audit annotations provided by vendors
- Develop and maintain tooling for managing evaluation datasets effectively
- Collaborate with model development teams to perform offline evaluations and automate evaluation pipelines
- Manage image and video data, facilitate queue setup, and ensure data integrity
- Audit results to ensure measurement accuracy and consistency
- Programmatically support evaluation tasks, including data management and result analysis
Other
- Bachelor’s degree in Computer Science, Engineering, or a related field (preferred but not mandatory)
- Strong attention to detail and analytical skills
- Excellent communication and collaboration abilities
- Flexibility to work across different time zones and schedules
- Nice-to-have: Experience as a GenAI user in the media domain
