Snorkel is looking to help enterprises transform expert knowledge into specialized AI at scale by building systems to power large-scale AI workloads for top tier AI research labs
Requirements
4+ years experience in delivering AI/ML systems and services in a production setting for cloud-native applications
Experience with distributed compute frameworks
Experience with the modern AI stack, including improving LLM applications through evals, prompting, and agent scaffolding
Ability to design and build efficient data storage, compute, and retrieval systems for AI/ML tasks
Strong development and debugging skills in Python
Experience with architecting and developing production web-scale systems (monitoring, telemetry, performance, reliability, triage and debug)
Experience developing evaluations and environments for complex multi-turn and multi-tool AI systems
Responsibilities
Own the architecture, design, development, and operations of large-scale systems designed for AI/ML tasks including distributed compute systems, data management systems, data engineering workflow systems, and end user experiences
Recognize and act on opportunities to integrate the latest agentic and foundation model technologies to power eval workflows
Prototype, optimize, and maintain scalable back-end services that will power new foundation model development tools
Design extensible and testable interfaces between internal services including the underlying storage and data models
Launch agents into production to accomplish long running reasoning and verification tasks
Work closely with other engineers, product managers, and field team members to ensure that Snorkel’s frontier AI datasets meet and surpass the capabilities of the most advanced foundation models
Build systems to power large-scale AI workloads for top tier AI research labs
Other
4+ years of experience
8+ years of professional software engineering experience (preferred)
Strong communication skills
Ability to work a hybrid schedule with 3 days per week in one of our offices in San Francisco or Redwood City
Bachelor's degree or equivalent experience (not explicitly mentioned but implied)
