Job Board
LogoLogo

Get Jobs Tailored to Your Resume

Filtr uses AI to scan 1000+ jobs and finds postings that perfectly matches your resume

Google Logo

Senior Software Engineer - AI Flow Core Inference

Google

$166,000 - $244,000
Aug 22, 2025
Mountain View, CA, USA
Apply Now

Google is looking to build a high-performing GenAI platform for first-party developers to apply ML into emerging and existing consumer products, ensuring scalability, reliability, and performance of APIs that scale globally.

Requirements

  • 5 years of experience with software development in one or more programming languages, and with data structures/algorithms.
  • 3 years of experience with ML infrastructure (e.g., model deployment, model evaluation, optimization, data processing, debugging).
  • 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture.
  • 3 years of experience building and developing large-scale infrastructure, distributed systems or networks, or experience with compute technologies, storage, or hardware architecture.
  • 3 years of experience with design and architecture; and testing/launching software products.
  • 3 years of experience with Gen AI algorithms and tools, LLMs or other multi-modal foundation models, natural language processing or inference performance optimization.

Responsibilities

  • Leverage products built by the rest of Google, build a high-performing GenAI platform for first-party developers to apply ML into emerging and existing consumer products.
  • Collaborate with other stakeholders (e.g., CoreML, Google Deepmind, Google Labs, Search, Vertex, etc) to ensure we deliver highly available, performant, and secure APIs that scale globally.
  • Design, develop, and maintain the infrastructure behind Google's first-party GenAI platform, ensuring scalability, reliability, and performance.
  • Build and enhance API features with generations of Gemini, Imagen, Veo, and other LLMs.
  • Collaborate with cross-functional teams to deliver high-quality, production-grade solutions.
  • Design, develop, test, deploy, maintain, and enhance software solutions.
  • Manage project priorities, deadlines, and deliverables.

Other

  • Bachelor’s degree or equivalent practical experience.
  • We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.