Google's Machine Learning (ML) Performance team is responsible for optimizing the performance and efficiency of machine learning and Artificial Intelligence (AI) workloads at Google. This involves identifying performance bottlenecks, implementing optimizations, and driving efficiency on large-scale ML models and new hardware accelerators to maintain Google's leadership in ML performance.
Requirements
- 8 years of experience in testing, and launching software products.
- 5 years of experience with software development in one or more programming languages (e.g., Python, C, C++).
- 3 years of experience in performance analysis including system architecture, performance, benchmarking and machine learning infrastructure.
- Experience in Machine Learning System (e.g., Background Theory, TensorFlow, and other tools).
- Experience in compiler optimizations or related fields.
- Experience in ML frameworks (e.g. Jax, Pytorch).
Responsibilities
- Identify and maintain LLM/non-LLM training and serving benchmarks, used by industry and ML community to identify performance opportunities and drive TensorFlow/JAX TPU performance.
- Work on scaling partitioning and algorithmic optimizations to Google products and ML models including model/data sharding, mesh sizes, quantization, sparsity, compiler tuning, and other model compression techniques, new ML model architecture/optimizer/training techniques to solve ML tasks more efficiently, or new techniques to reduce the label/unlabeled ML data needed to train a model to target accuracy.
- Engage with Google product teams to solve their LLM performance problems including onboarding new LLM models and products on Google new TPU hardware, enabling LLMs to train efficiently on a very large-scale.
- Analyze performance and efficiency metrics to identify bottlenecks, design, and implement solutions at Google fleet-wide scale.
Other
- Mountain View, CA, USA; Kirkland, WA, USA; Seattle, WA, USA
- Bachelor’s degree or equivalent practical experience.
- 3 years of experience in a matrixed organization including technical leadership role leading project teams and setting technical direction.
- US base salary range for this full-time position is $197,000-$291,000 + bonus + equity + benefits.
- Google is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status.
