Job Board
LogoLogo

Get Jobs Tailored to Your Resume

Filtr uses AI to scan 1000+ jobs and finds postings that perfectly matches your resume

Google Logo

Software Engineer III, Infrastructure, Inference Control Plane

Google

$141,000 - $202,000
Dec 10, 2025
Sunnyvale, CA, US
Apply Now

Google is looking to solve the problem of building a model serving platform for third-party, first-party, and open-source Gen AI models that is reliable, performant, cost effective, and easy-to-use.

Requirements

  • 2 years of experience with software development or 1 year of experience with an advanced degree in an industry setting.
  • 2 years of experience with developing large-scale infrastructure, distributed systems or networks, or experience with compute technologies, storage or hardware architecture.
  • Experience architecting and implementing scalable solutions using Kubernetes.
  • Experience in developing, deploying, managing, and maintaining Machine Learning infrastructure.
  • Experience building and deploying Large Language Models (LLMs) in production environments.
  • Experience developing accessible technologies.
  • Experience with data structures and algorithms.

Responsibilities

  • Write product or system development code.
  • Participate in, or lead design reviews with peers and stakeholders to decide amongst available technologies.
  • Review code developed by other developers and provide feedback to ensure best practices (e.g., style guidelines, checking code in, accuracy, testability, and efficiency).
  • Contribute to existing documentation or educational content and adapt content based on product/program updates and user feedback.
  • Triage product or system issues and debug/track/resolve by analyzing the sources of issues and the impact on hardware, network, or service operations and quality.
  • Developing large-scale infrastructure, distributed systems or networks, or experience with compute technologies, storage or hardware architecture.
  • Architecting and implementing scalable solutions using Kubernetes.

Other

  • Bachelor’s degree or equivalent practical experience.
  • Master's degree or PhD in Computer Science or related technical fields.
  • 2 years of experience with software development or 1 year of experience with an advanced degree in an industry setting.
  • Google is proud to be an equal opportunity workplace and is an affirmative action employer.
  • We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status.