Computer Vision Engineer

Meta•Sunnyvale, CA

5d•$121,992 - $181,000

About The Position

Reality Labs (RL) Sensors Team at Meta is helping build novel products in Augmented and Virtual Reality. Our team explores, develops, and delivers new cutting-edge sensing technologies that serve as the foundation of current and future AR/VR products at Meta. Sensors are a crucial component for enabling core features on our products such as world-locked rendering, hand, body & eye tracking, image stabilization, scene reconstruction, mapping, and health sensing. The team is composed of a multi-disciplinary team of engineers and scientists. We work cross-functionally across multiple products to deliver sensing solutions tailored for the requirements and constraints of each particular product/feature and develop platform technologies that can be reutilized across multiple products and product lines. We are looking for Software Engineers with experience in sensor technologies and want to build performant and scalable software pipelines for sensor fusion and multi-modal machine learning algorithms for AR/VR. In this role you will define and implement software frameworks and tools for efficient ingestion of sensor data, scalable model training and neural network architecture development, visualization of complex multi-modal sensor data, and more. You will collaborate with other engineers and researchers across Meta to develop new concepts and technologies for next generation sensor systems, including alternative sensing modalities and novel sensing algorithms.

Requirements

Currently has, or is in the process of obtaining a Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience. Degree must be completed prior to joining Meta
Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
5+ years of experience coding with C++ and Python for design and development of sensor fusion and machine learning technologies and systems
Demonstrated experience with modern machine learning frameworks such as PyTorch or TensorFlow
Familiarity with modern machine learning algorithms, specifically deep Convolutional Neural Networks (CNN), Recurrent Neural Networks (RNN), transformers, clustering, and dimensionality reduction
Experience with common digital signal processing techniques such as digital filtering, Fourier transform, correlation, and modulation
Experience in designing software systems and machine learning models targeted for edge devices

Nice To Haves

Familiarity with the emerging augmented reality and virtual reality technologies
Demonstrated experience in cross-group and cross-culture collaboration
Proven track record of achieving significant results as demonstrated by patents or first-authored publications
MS or PhD degree in Computer Science, Machine Learning, Robotics or related technical field
Experience developing novel approaches to complex technical problems, such as proposing new architectures, algorithms, or system designs
Familiarity with Simultaneous Localization and Mapping (SLAM) and Visual Inertial Odometry (VIO)
Experience with cameras and 3D image reconstruction techniques
Familiarity with cameras, inertial sensors, pressure sensors, magnetometers, and/or similar sensors

Responsibilities

Design and develop new frameworks and core software components to implement, optimize, visualize, and debug sensor fusion and machine learning algorithms
Design and implement state-of-the-art Machine Learning Algorithms using PyTorch, TensorFlow, or other platforms
Develop relationships and lead engagements with internal and external industrial and research partners to develop and scale novel technologies from incubation to production
Collaborate with other engineers and researchers across Meta to develop new concepts and technologies for next-generation sensor systems, including alternative sensing modalities and novel sensing algorithms that advance the state-of-the-art in AR/VR systems