Anthropic is looking to create reliable, interpretable, and steerable AI systems, and the Research Operations & Strategy Lead for Coding & Cybersecurity Data will play a key role in building and scaling data operations to advance Claude's coding and cybersecurity capabilities.
Requirements
- Proficiency in Python
- Understanding of ML workflows and evaluation frameworks
- Familiarity with how LLMs work and could describe how models like Claude are trained
- Experience with RLHF or similar human-in-the-loop training methods
- Domain expertise in software engineering or cybersecurity
- Knowledge of AI safety research methodologies and evaluation frameworks
Responsibilities
- Develop and execute data strategies for coding capabilities, cybersecurity evaluations, and agentic AI research
- Partner with research leaders to translate technical requirements into operational frameworks
- Build data collection and evaluation systems through internal tools, vendor partnerships, and new approaches
- Identify, evaluate, and manage specialized contractors and vendors for technical data collection
- Implement quality control processes to ensure data meets training requirements
- Manage multiple complex projects simultaneously, balancing technical needs with delivery timelines
- Track metrics and communicate progress to stakeholders
Other
- At least a Bachelor's degree in a related field or equivalent experience
- Location-based hybrid policy: currently, we expect all staff to be in one of our offices at least 25% of the time
- Visa sponsorship: we do sponsor visas, but we aren't able to successfully sponsor visas for every role and every candidate
- Strong communication skills and can effectively engage with both technical and non-technical stakeholders
- Highly organized and can manage multiple parallel workstreams effectively
