Google's ML at Scale Performance team needs to empower GCP customers with Gen AI workloads by supporting and optimizing performance for key model architectures. This involves optimizing open-source high-performance JAX implementations for Dense LLMs and Mixture of Experts LLMs MaxText and Diffusion models, and collaborating to optimize these workloads on GCP AI Hypercomputers.
Requirements
- 5 years of experience with software development in one or more programming languages.
- 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture.
- 3 years of experience with one or more of the following: Speech/audio (e.g., technology duplicating and responding to the human voice), reinforcement learning (e.g., sequential decision making), ML infrastructure, or specialization in another ML field.
- 3 years of experience with ML infrastructure (e.g., model deployment, model evaluation, optimization, data processing, debugging).
- 5 years of experience with data structures/algorithms.
- Experience developing accessible technologies.
Responsibilities
- Port and implement open-source Dense LLM, MoE and Diffusion models in MaxText and MaxDiffusion.
- Build and support JAX and its ecosystem to benefit GCP customers.
- Implement and optimize benchmarks to evaluate basic compute and communication operations.
- Support new accelerator introductions (TPUs/GPUs) on GCP and MLPerf submissions that demonstrate cutting-edge technologies for Gen AI workloads at scale.
- Work closely with product managers and partner teams to deliver high-quality software products and features throughout their life-cycle.
Other
- The US base salary range for this full-time position is $166,000-$244,000 + bonus + equity + benefits.
- Google is proud to be an equal opportunity workplace and is an affirmative action employer.
- We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status.
- We also consider qualified applicants regardless of criminal histories, consistent with legal requirements.
- If you have a disability or special need that requires accommodation, please let us know by completing our Accommodations for Applicants form.
