Job Board
LogoLogo

Get Jobs Tailored to Your Resume

Filtr uses AI to scan 1000+ jobs and finds postings that perfectly matches your resume

Google Logo

Software Engineer, TPU Performance

Google

$141,000 - $202,000
Aug 28, 2025
Sunnyvale, CA, US
Apply Now

Google's software engineers develop next-generation technologies that change how billions of users connect, explore, and interact with information. Products need to handle information at massive scale, extending beyond web search. The ML, Systems, and Cloud AI (MSCA) organization designs, implements, and manages hardware, software, machine learning, and systems infrastructure for all Google services and Google Cloud. The role focuses on building Machine Learning (ML) systems with Hardware and Software co-design and optimization, prioritizing security, efficiency, and reliability.

Requirements

  • 2 years of experience with software development in one or more programming languages.
  • 2 years of coding experience in one or more of the following languages: C, C++, Java, or Python.
  • 2 years of experience testing, maintaining, or launching software products.
  • 2 years of experience with data structures/algorithms.
  • Experience focused on ML algorithm and performance analysis and optimization.
  • Experience with architecture simulator development and microarchitecture.
  • Knowledge of computer architecture such as TPU's or other accelerators.
  • Knowledge with LLMs and ML frameworks and compilers.

Responsibilities

  • Design, develop, test, deploy, maintain, and enhance software solutions.
  • Build the Machine Learning (ML) systems with Hardware and Software co-design and optimization.
  • Analyze performance, power, and energy efficiency of current and future ML workloads to identify issues.
  • Enable the peak efficiency of future and current ML systems through full-stack ML hardware-software co-design by proposing Hardware-aware algorithm optimization and related simulation modeling.
  • Establish an understanding of the latest business-critical production ML models (e.g., large-language models, large embedding models) to inform optimizations of model architecture, software systems, and hardware architecture.
  • Explore and define future ML accelerator system and chip architectures with objective and data-driven insights.

Other

  • Manage project priorities, deadlines, and deliverables.
  • Excellent communication skills.