Research Scientist Intern, Multimodal Learning for Robotics (PhD)
About The Position
At Reality Labs Research, the goal is to explore, innovate, and design novel interfaces and hardware for the next generation of virtual, augmented, and mixed reality experiences. The team conducts research toward natural, seamless XR experiences that are effective, enjoyable, and functionally indistinguishable from those in the real world. The Research Scientist Intern will work at the intersection of robotic control, machine learning, and human-robot interaction, collaborating with researchers and mentors in these fields. The primary focus is developing computer vision and tactile-based algorithms for robotic control learning in dexterous manipulation tasks. Internships last 12 to 24 weeks, with various start dates throughout the year; some projects may require a minimum of 16 consecutive weeks.
Requirements
- Currently has or is in the process of obtaining a Ph.D. in Computer Science, Artificial Intelligence, Robotics, or a relevant technical field.
- Experience in computer vision, with active contributions in at least one subdomain (3D reconstruction, hand pose estimation, or object pose estimation) and strong familiarity across all of them.
- Understanding of state-of-the-art robotic manipulation control policies and experience with physics-based simulators such as Mujoco.
- Experience with Python, PyTorch or JAX, or other related languages.
- Must obtain work authorization in the country of employment at the time of hire and maintain ongoing work authorization during employment.
Nice To Haves
- A proven record of significant results, demonstrated through grants, fellowships, patents, or first-authored publications at leading workshops or conferences in robotics, machine learning, or computer vision, or similar venues.
- Experience with multimodal learning, including but not limited to tactile data.
- Experience working with robot manipulation.
- Experience building pipelines with foundation computer vision models, for example CLIP, DinoV2, or SAM2.
- Experience working and communicating cross-functionally in a team environment.
- Intent to return to the degree program after completing the internship or co-op.
- Availability for a minimum 16 consecutive week internship.
Responsibilities
- Conduct collaborative research on developing computer vision and tactile-based algorithms for human and robotics data.
- Develop robotic data pipelines for robotic dexterous manipulation, train models, and benchmark different algorithms.
- Collaborate with researchers and cross-functional partners, communicating research plans, progress, and results.
Benefits
- Benefits are mentioned, but no specific benefits are listed.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Intern
Education Level
Ph.D. or professional degree
