Amigo is looking to solve the problem of building trust and safety infrastructure for AI in mission-critical environments, specifically in healthcare and other regulated sectors.
Requirements
- Strong background in system safety and adversarial testing
- Experience with bias detection and fairness testing
- Knowledge of healthcare safety standards
- Understanding of statistical evaluation methods
- Track record of building evaluation systems for production software
- Healthcare or regulated industry experience
- Background in medical device testing or clinical trial design
Responsibilities
- Design evaluation frameworks for healthcare systems
- Build adversarial testing systems that identify potential failure modes before deployment
- Create safety evaluation protocols that ensure systems meet healthcare standards
- Design test suites that cover edge cases, rare diseases, and complex medical scenarios
- Build automated evaluation pipelines that continuously assess system performance
- Collaborate with healthcare professionals to develop clinically relevant evaluation metrics
Other
- Comprehensive health, dental, and vision insurance
- Mental health support and wellness coaching
- Flexible wellness stipend for fitness, therapy, or personal growth
- Annual learning budget for courses, books, or conferences
- Conference attendance budget for professional development
