Google's Ads Safety team needs to provide serving infrastructure for various classifiers, including Traditional ML Models, Rules, and large language models (LLMs). The primary focus is to ensure high scalability, reliability, efficiency, optimal utilization of machine resources, and extensibility to support a variety of classifiers, backends, and scenarios.
Requirements
- 8 years of software development experience, with designing and shipping large-scale, distributed systems.
- Experience with ML serving platforms or managing ML infrastructure at a large scale.
- Experience in at least one modern programming language such as C++, Java, Python, or Go.
- Experience with large-scale inference for Large Language Models (LLMs) and other modern AI techniques.
- Experience in optimizing performance for machine learning workloads on specialized hardware like TPUs, GPUs, and CPUs.
- Experience solving ambiguous and technically challenging problems, identifying root causes, and implementing systemic solutions.
Responsibilities
- Serve as the primary technical leader for the team, define the long-term technical goals for our serving infrastructure and to execute on that by managing the most complex, ambiguous technical issues.
- Design, implement, and launch highly reliable, low-latency, and fault-tolerant systems capable of managing massive inference traffic.
- Manage a small team of software engineers, fostering their career growth and technical skills.
- Advocate system reliability, scalability, and efficiency.
- Partner with peer teams to influence the broader Ads Safety machine learning (ML) Infrastructure strategy and technical roadmap.
- Act as the key individual contributor on critical projects, setting the technical bar and driving them from initial concept to launch.
Other
- Experience in a leadership role with direct reports, managing and mentoring junior engineers while maintaining individual contributor responsibilities.
- Versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.
- Google is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status.
- We also consider qualified applicants regardless of criminal histories, consistent with legal requirements.
- If you have a disability or special need that requires accommodation, please let us know by completing our Accommodations for Applicants form.
