At Meta Reality Labs, we’re developing advanced body encoding solutions and embodied agent systems with rich, multi-modal contextual understanding—enabling natural, expressive communication through realistic avatars. We are looking for a creative, skilled and motivated Research Scientist to build the core technologies that power seamless interactions for embodied agents.
Requirements
- Experience in training, fine-tuning, and/or experimenting with large language models
- Experience building multi-modal LLM solutions with full development cycle in an industry setting
- Publications in machine learning, computer vision, NLP, audio in peer-reviewed conferences (e.g. CVPR. ECCV, ICCV, NeurIPS, SIGGRAPH, ICML, ICLR, ICASSP)
- Experience solving complex problems and comparing alternative solutions, tradeoffs to determine a path forward
- Experience with joint hardware-software development and associated rapid prototyping
- Experience transferring technology from research in computer vision, machine perception or machine learning into a shipping product
- Demonstrated software engineer experience via an internship, work experience, coding competitions, or widely used contributions in open source repositories (e.g. GitHub)
Responsibilities
- Contribute to develop novel embodied agent systems for VR, MR and AR systems by applying and advancing state-of-the-art AI technologies
- Consistently and sustainably advance the state of AI for your problem, including setting and executing against roadmaps for 6-month plus timeframes
- Design and prototype interactive experiences and evaluate them through user research
- Design and prototype data collection/curation framework to accelerate algorithm development
- Collaborate and work across teams to develop and optimize end-to-end experiences
- developing state-of-the-art multi-modal LLMs for audio-visual understanding of users and behavior simulation
- motion synthesis models that drive human-like movement for realistic avatars
Other
- 2+ years of experience holding an industry, faculty, academic, or government researcher position
- Proven ability to effectively collaborate with cross-functional teams
- Individual compensation is determined by skills, qualifications, experience, and location.
- Meta is proud to be an Equal Employment Opportunity employer.
- Meta is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures.
