Oracle Cloud Infrastructure (OCI) is seeking a Senior Manager of Software Development to lead the team responsible for the foundational AI infrastructure powering Oracle’s GenAI and ML initiatives. This role will focus on critical components of OCI’s AI platform, including large-scale GPU cluster management, self-service ML infrastructure, end-to-end model lifecycle capabilities including training and serving.
Requirements
- 8+ years of experience in software engineering with 3+ years in a leadership or management role.
- Proven track record delivering scalable, production-grade systems in cloud infrastructure or AI/ML platforms.
- Deep knowledge of distributed computing, container orchestration (e.g., Kubernetes), and GPU-based infrastructure.
- Familiarity with Generative AI and LLM training and inference, ML frameworks, model deployment strategies, and inference optimization.
- Proven track record of running operations for a cloud service
Responsibilities
- Lead the development and operations of AI Platform supporting high-performance model training and inference.
- Build self-service capabilities for engineers and data scientists to manage GPU workloads, monitor usage, and streamline ML workflows.
- Design and deliver model lifecycle services —including training, fine-tuning, evaluation, and scalable model serving.
- Collaborate with internal science, product, research, and infrastructure teams to ensure AI workloads are optimized for performance, cost, and reliability.
- Ensure strong security, observability, and operational best practices across the platform.
- Inspire a culture of "Always On" Service Operations, including leading and participating in a 24x7x365 service operations on-call rotation.
- Drive strategic investments and architecture decisions in support of Oracle’s AI strategy.
Other
- Build and lead a high performing engineering team (7+ engineers).
- Mentor and grow a high-performing engineering team; establish a strong culture of technical excellence, accountability, and innovation.
- Sets Goals and Expectations for performance and works with employees to establish specific, measurable goals and commitments.
- Ability to work in a collaborative, cross-functional team environment
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field
