Anthropic is seeking an experienced Data Scientist to optimize AI systems for reliability, latency, and inference performance, aiming to improve user experiences and ensure AI systems operate reliably and efficiently at scale.
Requirements
- Deep understanding of distributed systems, cloud infrastructure, and performance engineering
- Expertise in experimental design, causal inference, statistical modeling, and A/B testing frameworks
- Proficiency in Python, SQL, and data analysis tools, with experience handling large datasets and real-time streaming data
- Experience translating technical performance metrics into user experience insights
- Track record of leveraging data science to improve system performance, user engagement, or business outcomes
- Experience in observability tools, machine learning infrastructure, SRE practices, or user behavior analysis are highly desirable.
Responsibilities
- Design and conduct comprehensive analyses to evaluate how latency, reliability, errors, and refusal rates impact user engagement, satisfaction, and retention
- Identify and prioritize infrastructure improvements through analysis of user behavior, system performance metrics, and their influence on business outcomes
- Develop methodologies to measure and monitor platform reliability, including defining key metrics, establishing baselines, and creating proactive monitoring systems
- Collaborate with engineering teams to design and analyze A/B tests and controlled experiments to assess platform improvements
- Investigate performance anomalies, conduct root cause analysis, and provide data-driven insights to guide engineering priorities
- Build predictive models for capacity planning, reliability forecasting, and resource optimization to maintain high performance at scale
- Present complex analyses and insights to technical and executive stakeholders clearly and effectively
Other
- 5+ years of hands-on experience in data science, preferably in high-scale technical environments
- Proven ability to collaborate effectively with engineering teams and communicate complex analyses to diverse audiences
- Flexible remote work policy with a requirement of at least 25% in-office presence
- Competitive salary range: $275,000 - $355,000 USD
- Comprehensive health, dental, and vision insurance
