Haize Labs needs a Staff+ Software Engineer to build a scalable and reliable AI reliability platform that enables customers to test, verify, and deploy AI applications, addressing the challenge of ensuring AI safety and production readiness.
Requirements
- Proficiency in one or more backend programming languages (e.g. Python, Go, Rust)
- Knowledgeable about modern cloud infrastructure, including technologies like Kubernetes and Terraform, and platforms like AWS, GCP, and Azure
- Understanding of relational and NoSQL databases (we use Postgres, MongoDB, and Redis, among others)
- Experience doing applied AI/ML
- Familiarity with security and privacy best practices
- Experience building and/or operating large scale, GPU-based model training and serving infrastructure
- Experience working on multi-datacenter, cloud-agnostic systems
Responsibilities
- Design and build scalable infrastructure and systems to orchestrate tens of thousands of LLM calls per second, powering functionality like model evaluations, red team attacks, runtime guardrails, and more
- Collaborate closely with the research team and deploy innovative new models to build industry-leading AI reliability tooling
- Interface directly with customers to understand and address their pain points, design intuitive new user workflows that streamline their journey, and guide them on the evaluation methodology Haize has pioneered
- Develop and uphold processes and best practices that reinforce the operational excellence of our team
Other
- Act as a technical leader across the organization, mentoring top talent and helping set technical direction and vision for the company
- Have 7+ years of industry experience, including 3+ years leading large initiatives as an engineer or manager
- Have a proven track record of designing, building, and scaling complex distributed systems that solve critical business problems
- Take a pragmatic, outcomes-focused approach to solving ambiguous technical and business problems
- Are passionate about building products and platforms that feel magical to use
- Education requirement: Bachelor’s degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
- Location policy: 6 days a week, in person, in NYC.
- US visa sponsorship: If you are exceptional, we will sponsor.
