DigitalOcean's GradientAI Infrastructure Team is looking to welcome a new Staff Product Manager to define a compelling new product in the AI/ML infrastructure space and partner deeply with an engineering team to make it a reality for our customers. The goal is to bring DigitalOcean Simplicity to the world of Large Language Model (LLM) hosting, serving, and optimization.
Requirements
- Strong technical depth - you understand modern AI/ML technologies (particularly those related to LLM hosting and inference). You can talk in depth with software engineers about their areas of expertise, or read technical documentation, and quickly recognize what is and is not of concern.
- Proven ability to build products for technical users, with a strong intuition for simple and clean user experience in complex environments.
- Track record of delivering high-impact products from concept to launch, including ownership of roadmaps, prioritization, and success metrics.
- Experience researching, evaluating, and building with open source technologies
- Experience with various GPU platforms from AMD and NVIDIA and associated toolsets for tuning, configuring, and accelerating AI/ML workloads on them would be ideal, but not required
- Experience with LLM hosting tools and frameworks (e.g., vLLM, llm-d) would be ideal, but not required
Responsibilities
- Define and own the product vision, roadmap, and success metrics for our net new LLM inference product
- Collaborate closely with engineering and design to bring new features and experiences to market, focusing on developer simplicity, performance, and scalability.
- Analyze usage data, market trends, and competitive dynamics to identify opportunities and shape a product strategy that balances innovation with reliability.
- Write clear product requirements and specifications, ensuring alignment across teams and driving execution from concept through launch.
- Represent the product internally and externally, sharing the roadmap with stakeholders, supporting customer-facing teams, and enabling go-to-market success.
- Continuously iterate and improve existing features based on feedback, performance metrics, and strategic shifts.
Other
- 10+ years of product management experience with a focus on AI/ML (ideally LLM) services, cloud platforms, or infrastructure products.
- Engage with customers directly to gather feedback, and validate solutions and use these insights to guide product decisions and prioritize the roadmap.
- Drive cross-functional alignment by communicating product goals, timelines, and rationale clearly and consistently across the company.
- A strong sense of ownership and a drive to figure out and resolve any issues preventing you and your team from delivering value to your customers
- Customer-focused mindset, with direct experience gathering insights and translating them into valuable product improvements.
