Job Board
LogoLogo

Get Jobs Tailored to Your Resume

Filtr uses AI to scan 1000+ jobs and finds postings that perfectly matches your resume

Google Logo

Senior Software Engineer, TPU Performance, Hardware/Software Co-Design

Google

$166,000 - $244,000
Aug 25, 2025
Sunnyvale, CA, US
Apply Now

Google's software engineers develop next-generation technologies that change how billions of users connect, explore, and interact with information. The ML, Systems, & Cloud AI (MSCA) organization designs, implements, and manages the hardware, software, machine learning, and systems infrastructure for all Google services and Google Cloud. This role will build ML systems with Hardware and Software co-design and optimization, enabling peak efficiency of future and current ML systems through full-stack ML hardware-software co-design by proposing HW-aware algorithm optimization and related simulation modeling.

Requirements

  • 5 years of experience with software development in one or more programming languages, and with data structures/algorithms.
  • 5 years of coding experience in one or more of the following languages: C, C++, Java, or Python.
  • 5 years of experience testing, maintaining, or launching software products.
  • Experience focused on ML algorithm and performance analysis and optimization.
  • Experience with architecture simulator development and microarchitecture.
  • Knowledge of computer architecture such as TPU's or other accelerators.
  • Knowledge or experience with LLMs and ML frameworks and compilers.

Responsibilities

  • Analyze performance, power, and energy efficiency of current and future ML workloads to identify challenges.
  • Enable the peak efficiency of future and current ML systems through full-stack ML hardware-software co-design by proposing HW-aware algorithm optimization and related simulation modeling.
  • Establish a deep understanding of the latest business-critical production ML models (e.g., large-language models, large embedding models) to inform optimizations of model architecture, software systems, and hardware architecture.
  • Explore and define future ML accelerator system and chip architectures with objective and data-driven insights.
  • Design, develop, test, deploy, maintain, and enhance software solutions.

Other

  • Bachelor’s degree or equivalent practical experience.
  • Excellent communication skills.