Job Board
LogoLogo

Get Jobs Tailored to Your Resume

Filtr uses AI to scan 1000+ jobs and finds postings that perfectly matches your resume

Google Logo

Senior Software Engineer, AI Flow Core Inference

Google

$166,000 - $244,000
Aug 21, 2025
Mountain View, CA, US
Apply Now

Google is looking to build a platform to integrate GenAI-based technologies into its suite of consumer-facing products, aiming to empower developers and researchers with GenAI enablement tools and drive innovation in Machine Learning (ML). The goal is to make the deployment of GenAI across Google as easy, economical, and fast as possible.

Requirements

  • 5 years of experience with software development in one or more programming languages, and with data structures/algorithms.
  • 3 years of experience with ML infrastructure (e.g., model deployment, model evaluation, optimization, data processing, debugging).
  • 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture.
  • 3 years of experience building and developing large-scale infrastructure, distributed systems or networks, or experience with compute technologies, storage, or hardware architecture.
  • 3 years of experience with design and architecture; and testing/launching software products.
  • 3 years of experience with Gen AI algorithms and tools, LLMs or other multi-modal foundation models, natural language processing or inference performance optimization.

Responsibilities

  • Design, develop, and maintain the infrastructure behind Google's first-party GenAI platform, ensuring scalability, reliability, and performance.
  • Build and enhance API features with generations of Gemini, Imagen, Veo, and other LLMs.
  • Leverage products built by the rest of Google, build a high-performing GenAI platform for first-party developers to apply ML into emerging and existing consumer products.
  • Collaborate with other stakeholders (e.g., CoreML, Google Deepmind, Google Labs, Search, Vertex, etc) to ensure we deliver highly available, performant, and secure APIs that scale globally.
  • Design, develop, test, deploy, maintain, and enhance software solutions.
  • Manage project priorities, deadlines, and deliverables.

Other

  • The US base salary range for this full-time position is $166,000-$244,000 + bonus + equity + benefits.
  • Google is proud to be an equal opportunity workplace and is an affirmative action employer.
  • We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status.
  • We also consider qualified applicants regardless of criminal histories, consistent with legal requirements.
  • If you have a disability or special need that requires accommodation, please let us know by completing our Accommodations for Applicants form.