Google's AI and Infrastructure team is redefining what's possible by empowering Google customers with breakthrough capabilities and insights through AI and Infrastructure at unparalleled scale, efficiency, reliability, and velocity. This role will contribute to developing and guiding critical projects in Google's on-device ML infrastructure, enabling on-device deployment of key models and improving their performance.
Requirements
- 7 years of experience leading technical project strategy, ML design, and working with industry-scale ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
- 5 years of experience with one or more of the following: Speech/audio (e.g., technology duplicating and responding to the human voice), reinforcement learning (e.g., sequential decision making), ML infrastructure, or specialization in another ML field.
- 5 years of experience with design and architecture and testing or launching software products.
- Experience in ML frameworks, e.g., PyTorch, JAX, TensorFlow.
- Experience with on-device ML SDKs/tooling, (e.g., TensorFlow Lite, ExecuTorch, Core ML, SNPE/QNN).
- Knowledge of ML converters/compilers and run times, and hardware-accelerated ML inference techniques.
- Understanding of Generative AI model architectures and their optimization for on-device execution.
Responsibilities
- Develop and guide critical projects in Google's on-device ML infrastructure.
- Enable on-device deployment of key models, across various accelerators (GPU/Pixel TPU/NPUs/CPU) on Android, Chrome, and more.
- Improve performance of on-device model inference via optimizations in the model structure, on-device runtime and kernel implementation.
- Develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another.
- Work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve.
- Drive innovation and advance what's possible with on-device ML.
Other
- 8 years of experience in software development.
- Versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack.
- Passion for innovation and to advance what's possible with on-device ML.
