Job Board
LogoLogo

Get Jobs Tailored to Your Resume

Filtr uses AI to scan 1000+ jobs and finds postings that perfectly matches your resume

Google Logo

Senior Software Engineer, AI/ML, Runtime Engines

Google

$166,000 - $244,000
Nov 11, 2025
Sunnyvale, CA, US
Apply Now

Google's software engineers develop next-generation technologies that change how billions of users connect, explore, and interact with information. Products need to handle information at massive scale, and extend well beyond web search. The ML, Systems, & Cloud AI (MSCA) organization designs, implements, and manages the hardware, software, machine learning, and systems infrastructure for all Google services and Google Cloud. This role will deliver and maintain a consistent, reliable training and inference workflow for customers, integrating ML advancements from research into performant production infrastructure.

Requirements

  • 5 years of experience with software development in one or more programming languages.
  • 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture.
  • 3 years of experience with one or more of the following: speech/audio (e.g., technology duplicating and responding to the human voice), reinforcement learning (e.g., sequential decision making), or specialization in another ML field.
  • 3 years of experience with ML infrastructure (e.g., model deployment, model evaluation, optimization, data processing, debugging).
  • 5 years of experience with data structures/algorithms.
  • Experience in Machine Learning and High Performance Computing (HPC).
  • Ability to debug and program concurrent/parallel computations.

Responsibilities

  • Write and test product or system development code.
  • Collaborate with peers and stakeholders through design and code reviews to ensure best practices amongst available technologies (e.g., style guidelines, checking code in, accuracy, testability, and efficiency).
  • Design and implement solutions in one or more specialized ML areas, leverage ML infrastructure, and demonstrate expertise in a chosen field.
  • Increment migrate existing frameworks (TensorFlow, JAX, PyTorch) runtimes (TensorFlow runtime, JetStream) and custom workflows from TPU to GPU and minimizing any user disruption.
  • Enable open-source components integration (with frameworks, compilers) in OSS and strive to become a de-facto standard for ML infrastructure for everyone.
  • Deliver and maintain a consistent, reliable training and inference workflow for customers, integrating ML advancements from research into performant production infrastructure.
  • Partner with first-party and third-party Cloud customers.

Other

  • Bachelor’s degree or equivalent practical experience.
  • 1 year of experience in a technical leadership role.
  • Ability to debug correctness and performance issues at all levels of the stack.
  • We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.
  • Google is proud to be an equal opportunity workplace and is an affirmative action employer.