Red Hat is looking to solve the problem of bringing the power of open-source LLMs and vLLM to every enterprise, and accelerate AI for the enterprise by providing a stable platform for enterprises to build, optimize, and scale LLM deployments.
Requirements
- 5+ years of significant hands-on software development and system design experience
- 5+ years of experience in managing software engineering teams
- Proven experience in leading machine learning engineering teams, with a track record of successful project delivery and development of software engineers and engineering managers
- Experience in machine learning frameworks and tools, such as PyTorch, and HuggingFace
- Excellent programming skills in languages like Python, C++/CUDA, or Triton
- Highly experienced in running and analyzing LLM performance benchmarks
- Solid understanding of machine learning compilers concepts
Responsibilities
- Setting the overarching vision, objectives, and strategies for a group of engineering teams
- Lead and inspire a distributed team of individual contributors and managers, fostering a collaborative and innovative work environment
- Engage with the AI and machine learning open source communities such as vLLM, llm-d, and other open source communities
- Work with product management and engineering teams to develop technology roadmaps and schedules, and communicate these schedules externally
- Work with cross-functional engineering managers and teams on documentation, product management, and quality assurance to coordinate tasks necessary for releasing enterprise-quality MLOps software
- Working closely with the technical leads and scrum leads to direct the team in agile development
- Mentor and nurture team members in their career development, and professional growth
Other
- Ability to lead and work with diverse and distributed teams from multiple countries and cultures
- Excellent written and verbal communication skills
- Bachelor's, Master's, or Ph.D. degree in a relevant field (not explicitly mentioned but implied)
- 5+ years of experience in managing software engineering teams
- Ability to recruit and build a world-class engineering team
