Job Board
LogoLogo

Get Jobs Tailored to Your Resume

Filtr uses AI to scan 1000+ jobs and finds postings that perfectly matches your resume

Red Hat Logo

Senior Software Engineer, AI Model Serving

Red Hat

$116,270 - $191,840
Sep 16, 2025
Raleigh, NC, US
Apply Now

The Red Hat OpenShift AI (RHOAI) team is looking to create a platform, partner ecosystem, and community by which enterprise customers can solve problems to accelerate business success using AI, specifically focusing on hybrid cloud MLOps platforms.

Requirements

  • Experience with monitoring and alerting tools such as Prometheus and Grafana
  • Strong experience developing applications in Python, GoLang is a plus
  • Strong experience in Kubernetes or OpenShift
  • Experience with source code management tools such as Git
  • Familiarity with data science workflows and machine learning pipelines
  • Experience with development for public cloud services (AWS, GCE, Azure)
  • Experience working with or deploying MLOps platforms

Responsibilities

  • Contribute to the architecture, design, development, and testing of new features and solutions for RHOAI
  • Innovate in the MLOps domain by participating in upstream communities, such as KubeFlow and KServe
  • Ensure non-functional requirements including security, resiliency, and maintainability are met
  • Write unit and integration tests and work with quality engineers to ensure product quality
  • Use CI/CD best practices to deliver solutions as productization efforts into RHOAI
  • Contribute to a culture of continuous improvement by sharing recommendations and technical knowledge with team members
  • Proactively utilize AI-assisted development tools (e.g., GitHub Copilot, Cursor, Claude Code) for code generation, auto-completion, and intelligent suggestions to accelerate development cycles and enhance code quality

Other

  • Minimum of 5 years of experience
  • Passion for writing and maintaining reliable code
  • Excellent written and verbal communication skills; fluent English language skills
  • Autonomous work ethic, thriving in a dynamic, fast-paced environment
  • Bachelor’s degree or higher in computer science or a related discipline is valued, but not required