Job Board
LogoLogo

Get Jobs Tailored to Your Resume

Filtr uses AI to scan 1000+ jobs and finds postings that perfectly matches your resume

Google Logo

Senior Software Engineer, AI/ML Infrastructure, Core

Google

$166,000 - $244,000
Oct 3, 2025
Seattle, WA, US
Apply Now

Google's software engineers develop next-generation technologies that change how billions of users connect, explore, and interact with information. Products need to handle information at massive scale, and extend well beyond web search. The Infrastructure and Applied Artificial Intelligence (AI) team works closely with research, infrastructure, and product teams at the edge of what is technologically possible for models and infrastructure to deliver on its mission. The Core team builds the technical foundation behind Google’s flagship products, owning and advocating for the underlying design elements, developer platforms, product components, and infrastructure at Google. These are the essential building blocks for excellent, safe, and coherent experiences for users and drive the pace of innovation for every developer. The Core team has a mandate and a unique opportunity to impact important technical decisions across the company.

Requirements

  • 5 years of experience with software development in one or more programming languages.
  • 3 years of experience testing, maintaining or launching software products, and 1 year of experience with software design and architecture.
  • 3 years of experience with ML Infrastructure.
  • Experience with the life-cycle of building products with Machine Learning (e.g., idea, prototype, evaluations, data-driven experimentation, productizing).
  • Experience with serving infrastructure and building scalable distributed systems.
  • Experience in Backend and Application Programming Interface (API) development, including agentic infrastructure.
  • Experience in Java, C++ or Python.

Responsibilities

  • Explore and implement performance and efficiency optimizations for serving the Gemini for Google model family, effectively handling Google's TPU and model serving constraints.
  • Influence the Large Language Model Operations (LLMOps) processes of the team.
  • Influence, design, and drive the implementation of necessary Platform fundamental building blocks, infrastructure extensions and partner-specific customizations necessary to launch features in our partner surfaces and tools.
  • Provide technical leadership necessary for delivering Developer Artificial Intelligence (DevAI) solutions built on the DevAI Platform to our partner teams.
  • Identify partner requirements, defining shared roadmaps, and creating a technical strategy for the platform team to deliver on these roadmaps.

Other

  • Sunnyvale, CA, USA; Seattle, WA, USA
  • Experience engaging with emerging, changing client teams.
  • Google is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. See also Google's EEO Policy and EEO is the Law. If you have a disability or special need that requires accommodation, please let us know by completing our Accommodations for Applicants form.