Datadog's AI platform needs to provide tools and platforms for data scientists and engineers to conduct large-scale training and inference with ease, supporting products like Bits AI and LLMObs, and all AI research. The Evaluation & Annotation team specifically needs to address challenges in AI model evaluation, human annotation tooling, and synthetic/AI-generated datasets.
Requirements
- A Software Engineer at heart with a previous experience leading software engineering teams, as a tech lead or people manager
- Strong technician with a mix of backend, data engineer and infrastructure experience who is interested in remaining a hands-on leader
Responsibilities
- Manage and grow the Evaluation & Annotation team, directly managing 6-8 engineers
- Define our technical roadmap in alignment with AI platform goals and the Applied AI team roadmap.
- Work with our core platform teams to tailor Datadog's storage and data pipelines to our needs
- Create a strong team culture aligned with our engineering standards and our customer focus
- Participate in hands-on work: Code reviews, design reviews and some coding
- AI model evaluation both offline and online
- Designing tooling and processes around human annotation
Other
- Excellent leader with strong interpersonal skills, and the ability to build and lead high-performing teams
- Interested in working on an early stage project with many challenges to solve and a fast iteration cycle
- You build strong partnerships with cross-functional teams, including engineering, product, and science, and skillfully coordinate among multiple stakeholders
- You have a track record of delivering high-quality software on schedule and making decisions in ambiguous and fast-paced environments
- Datadog values people from all walks of life. We understand not everyone will meet all the above qualifications on day one. That's okay. If you're passionate about technology and want to grow your skills, we encourage you to apply.
