The Surreal Team at Meta’s Reality Lab Research is looking to solve problems in ego-centric machine perception and robotics AI, including areas such as transfer learning, learning from demonstration, reinforcement learning, perception, representation learning, robot control, navigation, mobile manipulation, dexterous manipulation, vision-language models, and contextually aware AI.
Requirements
- 5+ years of experience with any of the following research areas: computer vision, robotics, 3D reconstruction, computational imaging, image / video understanding, motion planning, embodied AI, human-robot interaction, sim-to-real transfer, learning from demonstration, reinforcement learning, dexterous manipulation
- 5+ years of experience with C/C++ and Python programming
- 5+ years of experience with deep learning frameworks: pytorch or tensorflow
- Experience with robotics frameworks like ROS, along with experience working with robotic simulations and real-world robots
- Experience with research areas such as vision language models, egocentric perception, LLMs, NLP
- Experience with manipulating and analyzing complex, large scale, high-dimensionality data from varying sources
Responsibilities
- Plan and execute engineering development to advance the state-of-the-art in machine perception and robotics tasks such as 3D reconstruction, computational imaging, image / video understanding, navigation, dexterous manipulation, whole-body controlling, long-horizon reasoning, etc
- Build data collection / generation platforms and develop algorithms based on state-of-the-art machine learning and neural network methodologies
- Invent/improve novel data-driven paradigms for robotics intelligence, including AR, VR, machine perceptions and robotics, leveraging a variety of modalities (images, video, text, audio, tactile, etc)
- Investigate paradigms that can deliver a spectrum of robotics behaviors - from simulated characters to real robots, and from short-horizon, low-level to long-horizon, high-level intelligence
- Define, build and benchmark new technologies needed for the next generation of AI
Other
- Currently has, or is in the process of obtaining a Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
- Must obtain work authorization in the country of employment at the time of hire and maintain ongoing work authorization during employment
- Ph.D. or M.S. degree in the following fields: Computer Science, Software Engineering, Robotics or related field
- Proven track record of achieving significant results as demonstrated by grants, fellowships, patents, as well as publications at leading workshops, journals or conferences
- Experience working and communicating cross functionally in a team environment
