Seed Global Data is focused on producing international data for LLMs. The LLM Training Operations Analyst will play a pivotal role in managing the intricate processes involved in training Large Language Models (LLMs) with diverse datasets, overseeing and improving operational workflows, ensuring high quality and efficiency, and leveraging advanced data analysis and prompt engineering capabilities to drive strategic decision making.
Requirements
- Demonstrated experience with data manipulation and analysis, including proficiency with no-code data platforms (Airtable, Lark Base, or similar)
- Proven ability to create dashboards and conduct rapid analysis to support operational and strategic decision making
- Experience in LLM training and eval project management and prompt engineering for model optimization
- SQL proficiency for complex data extraction and analysis
- Advanced prompt engineering experience with demonstrated ability to optimize models for both technical and administrative applications
- Comfort with technology and tools that enhance project and team performance
Responsibilities
- Design, manage, and optimize workflows for LLM training projects, including training design, QA processes, and performance tracking.
- Apply prompt engineering expertise to optimize model training and evaluation projects.
- Design and implement prompts that enhance model performance for both technical training tasks and administrative workflow automation.
- Continuously refine prompting strategies to improve project outcomes and operational efficiency.
- Lead comprehensive data manipulation and analysis initiatives to support operational decision-making, managing no-code data platforms like Airtable and Lark Base for data organization.
- Create dynamic dashboards in sheets and other spreadsheet tools, and manage no-code data tables to conduct rapid analysis that answers critical operational questions.
- Conduct quality and productivity improvement experiments to enhance operational processes.
Other
- 3+ years of experience in project or operations management roles
- Ability to balance independent judgment with collaborative teamwork in a fast-paced, project-based environment
- Enthusiasm for learning, engaging with diverse case studies, and working with global teams
- Provide mentorship and guidance to team members, helping to develop their skills and ensuring the delivery of high-quality outputs.
- Strong track record of connecting analytical work to overarching organizational goals and strategic initiatives
- Proven ability to lead and mentor entry-level team members
