Job Board
LogoLogo

Get Jobs Tailored to Your Resume

Filtr uses AI to scan 1000+ jobs and finds postings that perfectly matches your resume

Google Logo

Senior Software Engineer - AI/ML Infrastructure - Core

Google

$166,000 - $244,000
Aug 29, 2025
Sunnyvale, CA, USA
Apply Now

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google's needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

Requirements

  • 5 years of experience with software development in one or more programming languages.
  • 3 years of experience testing, maintaining or launching software products, and 1 year of experience with software design and architecture.
  • 3 years of experience with ML Infrastructure.
  • 5 years of experience with data structures/algorithms.
  • Experience with the life-cycle of building products with Machine Learning (e.g., idea, prototype, evaluations, data-driven experimentation, productizing).
  • Experience with serving infrastructure and building scalable distributed systems.
  • Experience in Backend and Application Programming Interface (API) development, including agentic infrastructure.

Responsibilities

  • Explore and implement performance and efficiency optimizations for serving the Gemini for Google model family, effectively handling Google's TPU and model serving constraints.
  • Influence the Large Language Model Operations (LLMOps) processes of the team.
  • Influence, design, and drive the implementation of necessary Platform fundamental building blocks, infrastructure extensions and partner-specific customizations necessary to launch features in our partner surfaces and tools.
  • Provide technical leadership necessary for delivering Developer Artificial Intelligence (DevAI) solutions built on the DevAI Platform to our partner teams.
  • Identify partner requirements, defining shared roadmaps, and creating a technical strategy for the platform team to deliver on these roadmaps.

Other

  • Experience engaging with emerging, changing client teams.
  • display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.