Research Engineer - Machine Learning for Behavioral AI
About The Position
Meta's Reality Labs Research (RL-R) brings together a world-class team of researchers, developers, and engineers to create the future of Mixed Reality (MR), Augmented Reality (AR), and Wearable Artificial Intelligence (AI). Within RL-R, the ACE team solves complex challenges in behavioral inference from sparse information. We leverage multimodal, egocentric data and cutting edge machine learning to deliver robust, efficient models that serve everyone. Our research provides core building blocks to unlock comfortable, intuitive, and helpful Wearable AI, empowering everyone to harness the superpowers of this emerging technology in their daily lives. We are looking for an AI ML engineer to join us in this initiative. In this role, you will work closely with Research Scientists and Engineers from across RL-R to develop novel state-of-the-art AI algorithms to infer human behavior patterns, with an emphasis on those that inform attention, cognition or emotion. Examples include longitudinal gaze behaviors, gestures, or vocal cues. You will develop end-to-end wearable AI experiential validation platforms using cutting edge generative AI and language models to validate the impact of these signals. Further, you will work with system engineers to optimize these models for efficiency and latency in constrained compute platforms. You will learn constantly, dive into new areas with unfamiliar technologies, and embrace the ambiguity of AR, VR, and AI problem solving. Together, we are going to build cutting-edge prototypes, technologies, and toolsets that can define a paradigm shift in how we interact with our surroundings. We invite you to step into the adventure of a lifetime, as we make science fiction real and change the world.
Requirements
- Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
- Bachelor's degree plus 5+ years experience or a PhD degree in Computer Science or other relevant technical field plus 2+ years experience, or equivalent practical experience
- Experience with Python
- Experience with a common machine learning framework (preferably PyTorch)
- Experience with ML computer vision
- Experience developing, maintaining and improving (accuracy, speed, compute costs) complex ML systems
Nice To Haves
- Experience with multimodal sensing platforms, multimodal signal processing and analysis, and converting raw sensor streams into robust models solving complex tasks
- Experience with 3D engines such as Unreal or Unity
- Experience working in Augmented Reality or Virtual Reality
- Experience with Multimodal Deep Learning approaches and research
- Experience developing software in a research environment
- Experience with C++
- Experience with non-Machine Learning computer vision, especially with OpenCV
- Experience with Large Language Models
Responsibilities
- Directly contribute to experiments, including designing experimental details, writing reusable code, running evaluations, and organizing results
- Contribute to publications and open-sourcing efforts
- Work with a large team
- Help identify long-term ambitious research goals as well as intermediate milestones
- Prioritize research that can be applied to Meta's product development
- Mentor other team members. Play a significant role in healthy cross-functional collaboration
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Industry
Broadcasting and Content Providers
Number of Employees
5,001-10,000 employees
