Reality Labs Research is looking to explore, innovate and design novel interfaces and hardware for the next generation of virtual, augmented, and mixed reality experiences, with a focus on developing CV and tactile based algorithms for robotic control learning in dextrous manipulation tasks.
Requirements
- Experience in computer vision, with active contributions in at least one subdomain (3D reconstruction, hand pose estimation, object pose estimation) and strong familiarity across all
- Understand state of the art in robotic manipulation control policies, with experience in physics based simulators like Mujoco
- Experience with Python, PyTorch or JAX, or other related languages
- Experience with multimodal learning including but not limited to tactile data
- Experience working with robot manipulation
- Experience with building pipelines with foundation CV models, for example, CLIP, DinoV2 or SAM2
Responsibilities
- Conduct collaborative research on developing CV and tactile based algorithms for both human and robotics data.
- Develop robotic data pipelines for robotic dextrous manipulation, train models, and benchmark different algorithms.
- Collaborate with researchers and cross-functional partners including communicating research plans, progress, and results.
Other
- Currently has or is in the process of obtaining a Ph.D. degree in Computer Science, Artificial Intelligence, Robotics, or relevant technical field
- Must obtain work authorization in the country of employment at the time of hire and maintain ongoing work authorization during employment
- Intent to return to the degree program after the completion of the internship/co-op
- Availability for minimum 16 consecutive week internship
- Proven track record of achieving significant results as demonstrated by grants, fellowships, patents, as well as first-authored publications at leading workshops or conferences
