Research Scientist, Optimization (PhD)

Meta • Burlingame, CA

37d

About The Position

As a research scientist, your primary objective will be to develop creative solutions that optimize computational efficiency for training and on-device inference of foundational vision and language models for use cases in VR, AR and mobile devices. Models of interest range from foundational vision models like Segment Anything to LLMs. Optimizations can range all the way from kernel level optimizations, low precision training and inference to efficient building blocks for models, improved model architectures, optimizers and pre-training techniques. Strong expertise in building efficient models, efficient training methods and model compression is preferred for this position.

Requirements

• Currently has, or is in the process of obtaining, a PhD degree in Machine Learning (ML) Systems, Natural Language Processing (NLP), Machine Learning, Artificial Intelligence, relevant technical field, or equivalent practical experience. Degree must be completed prior to joining Meta
• Currently has, or is in the process of obtaining a Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience. Degree must be completed prior to joining Meta
• Hands-on experience in deep learning algorithms and techniques, e.g., transformers, convolutional neural networks, quantization and/or related areas
• 3+ years experience with deep learning software libraries such as PyTorch or TensorFlow
• Demonstrated software engineering experience within a complex codebase via an internship, work experience, coding competitions, or widely used contributions to open source repositories such as GitHub
• Must obtain work authorization in country of employment at the time of hire, and maintain ongoing work authorization during employment

Nice To Haves

• Experience working and communicating cross-functionally in a team environment
• Proven track record of achieving significant results as demonstrated by grants, fellowships, patents, as well as first-authored publications at leading workshops or conferences such as ICLR, NeurIPS, ACL, EMNLP, ICML, MLSys, KDD, OSDI, etc
• Experience in related fields of improving the training and inference efficiency, data efficient learning, domain adaptation and semi-supervised learning
• Experience in kernel development for both GPU and mobile devices
• Experience in in related fields of efficient deep learning, training acceleration, quantization, model/accelerator co-design, and co-optimization

Responsibilities

• Develop model optimization algorithms and infrastructure to enable deployment of models in resource-constrained settings, such as mobile phones and AR/VR and MR devices.
• Optimize models on hardware to achieve the best performance given various real time latency and power constraints.
• Develop novel techniques to improve training efficiency and data efficiency.
• Lead and contribute to cutting-edge research that results in industry-leading tech demos and/or publications.
• Collaborate with cross-disciplinary research and engineering teams.

What This Job Offers

• Job Type: Full-time
• Education Level: Ph.D. or professional degree