DataRobot's AI Compute team needs to build and operate the foundational computing backbone that powers all of DataRobot's AI products and customer workloads, ensuring performance, efficiency, and enabling the future of AI.
Requirements
- Expert proficiency in Kubernetes architecture and operations including resource management/scheduling, auto-scaling, Gateway API/Ingress, Prometheus, and OpenTelemetry or experience with other orchestrators like nomad/slurm
- Experience with gpu clusters, either as a user or administrator or experience in multi-node AI/ML
- Experience setting technical direction, making architectural decisions, and driving consensus across multiple teams and stakeholders
- Expert in developing a wide variety of software with Python (5+ years)
- Experience designing and operating diverse CI/CD pipelines with Harness.io
- Experience designing and innovating large-scale horizontal and vertically-scaled build, testing, and deployment systems for Kubernetes environments and familiarity with Helm charts
- Golang, Terraform and Terragrunt
Responsibilities
- Build a system that ensures micro-services are secure, performant, reliable, and can go from idea to production in an hour.
- Build a system that continuously provides recommendations to right-size computing resources for Kubernetes to ensure efficient cloud spending for ourselves and our customers.
- Design and architect automated quality platforms to go from Enterprise-Grade releases from once-a-quarter to once-a-week to once-per-day to once-per-hour without sacrificing performance, security, or reliability
- Work with Product, Legal and Security to ensure the continuous delivery processes you build are compliant and secure
- Work with the team to ensure pipelines have clear playbooks and can operate 24/7 without you
- Work with a diverse group of architects and platform engineers across our R&D department to set continuous delivery and performance requirements for all production services
- Work with internal product managers to set roadmaps and define milestones to deliver innovative and simple solutions to our many teams’ continuous delivery and platform engineering issues
Other
- Lead by example—rolling up your sleeves as a technical contributor to solve complex problems, shaping architecture, and mentoring engineers to do their best work and advance their careers.
- This role includes participation in an on-call rotation—we believe in shared ownership of our platform and aim to build systems that are resilient, observable, and require minimal intervention.
- Able to influence others in the organization even where they lack explicit authority
- Proven track record for leading large-scale projects to completion across dozens of teams/Pods
- Experience mentoring senior engineers, fostering a positive team culture, and promoting continuous learning and improvement among colleagues
