DeepMind's Affective Computing group is looking to advance the state of the art in artificial intelligence, specifically in the area of socio-emotional understanding and generation tasks in audio-, visual-, and audiovisual settings, with a focus on multi-agent interactions and the development of Artificial General Intelligence.
Requirements
- Proven experience working with LLMs.
- Audio or video understanding and/or generation experience.
- Proven track record of research and publications in some of the following areas: audio generation, video generation
- Experience of JAX, PyTorch or similar training frameworks
- Experience in Python and/or C++
- Experience applying and productionizing state-of-the-art large audiovisual, language and/or multimodal research
Responsibilities
- Unlocking new multimodal affective capabilities in large models, both pre-training and post-training, focusing on audiovisual conversations and social agents.
- Improving quality of models for understanding and generation.
- Research to improve tokenizers, better techniques for generation quality, distill for on-device, and looking at joint audio and visual representations.
- Developing better evaluation methods (human, auto raters, automated metrics) to measure quality of open-ended tasks.
Other
- PhD in Artificial Intelligence, Machine Learning, or related field. Open also to backgrounds in Psychology (Social, Developmental, Cognitive), but must have strong Computational emphasis.
- Diverse experience collaborating cross-function and with other researchers
- The US base salary range for this full-time position is between $166,000 - $244,000 + bonus + equity + benefits.
- We value diversity of experience, knowledge, backgrounds and perspectives and harness these qualities to create extraordinary impact.
- We are committed to equal employment opportunity regardless of sex, race, religion or belief, ethnic or national origin, disability, age, citizenship, marital, domestic or civil partnership status, sexual orientation, gender identity, pregnancy, or related condition (including breastfeeding) or any other basis as protected by applicable law.
- If you have a disability or additional need that requires accommodation, please do not hesitate to let us know.
