Research Scientist, Trustworthy Learning under Uncertainty (TLU) - Large Behavior Models

Toyota Research Institute • Los Altos, CA

89d • $176,000 - $264,000

About The Position

At Toyota Research Institute (TRI), we’re on a mission to improve the quality of human life. We’re developing new tools and capabilities to amplify the human experience. To lead this transformative shift in mobility, we’ve built a world-class team in Automated Driving, Energy & Materials, Human-Centered AI, Human Interactive Driving, Large Behavior Models, and Robotics. The Mission is to conduct cutting-edge research that will enable general-purpose robots to be reliably deployed at scale in human environments. The Challenge envisions a future where robots assist with household chores and cooking, aid the elderly in maintaining their independence, and enable people to spend more time on the activities they enjoy most. To achieve this, robots need to be able to operate reliably in messy, unstructured environments. Recent years have witnessed a surge in the use of foundation models in various application domains, particularly in robotics. These “large behavior models” (LBMs) are enhancing the abilities of autonomous robots to perform various complex tasks in open and interactive environments. TRI Robotics is at the forefront of this emerging field by applying insights from foundation models, including large-scale pre-training and generative deep learning. However, it remains a challenge to ensure the reliability of LBMs for large-scale deployment in diverse operating conditions. The Team aims to make progress on some of the hardest scientific challenges around the safe and effective usage and development of machine learning algorithms within robotics. The research mission of the Trustworthy Learning under Uncertainty (TLU) team within the Robotics division is to enable the robust, reliable, and adaptive deployment of LBMs at scale in human environments. To guarantee dependable deployment at scale in the years to come, we are dedicated to enhancing trustworthiness of LBMs through three key principles: ensuring objective assessment of policy performance (Rigorous Evaluation), improving the ability to detect and handle unknown situations and return to nominal performance (Failure Detection and Mitigation), and developing the capability to identify and adapt to new information (Active / Continual Learning). Our team has deep cross-functional expertise across controls, uncertainty-aware ML, statistics, and robotics. We measure our success in terms of algorithmic advancements in the state-of-the-art and publications of these results in high-impact journals and conferences. We value contributions of reproducible and usable open-source software.

Requirements

• 4+ years of relevant industry experience or a Ph.D. in Machine Learning, Robotics, or related fields.
• Passionate about large scale challenges in ML grounded in physical systems, especially in the space of robotic manipulation.
• Expertise in Multi-Modal Foundation Models, Generative Modeling, Imitation Learning, Reinforcement Learning, Planning & Control, Statistics, Uncertainty Estimation, Out-of-Distribution Detection, Safety-Aware & Robust ML, (Inter)Active Learning, and/or Online / Continual Learning.
• A strong track record of publication at high-impact conferences/journals on some of the aforementioned topics.
• Proficiency with one or more coding languages and systems, preferably Python, Unix, and a Deep Learning framework (e.g., PyTorch).
• Ability to collaborate with other researchers and engineers of the TLU team, and, more broadly, the Robotics division to invent and develop interesting research ideas.
• A reliable teammate who loves to think big, go deeper, and deliver with integrity.

Nice To Haves

• Some familiarity with robots and the challenges inherent in conducting research on physical hardware platform.
• Familiarity with data pipelines, model serving and optimization, cloud training, and dataset management.

Responsibilities

• Work as part of a dynamic, closely-knit team conducting research on reliable, robust, and adaptive deployment of machine learning models in robot manipulation.
• Push the boundaries of knowledge and the state-of-the-art in Robotics and LBMs.
• Contribute to cutting-edge development in the areas of: Rigorous Policy Evaluation, Failure Detection and Mitigation, and Active / Continual Learning.
• Be a key member of the team and play a critical role in rapid progress measured by both the development of internal capabilities and high-impact external publication.
• Collaborate with internal research scientists and engineers across the TLU team, Robotics division, TRI, and Toyota, as well as our university partners across top academic research universities.
• Present results in verbal and written communications at international conferences, internally, and via open-source contributions to the community.

Benefits

• 401(k) eligibility
• various paid time off benefits, such as vacation, sick time, and parental leave
• annual cash bonus structure

What This Job Offers

• Career Level: Mid Level
• Education Level: Ph.D. or professional degree
• Number of Employees: 101-250 employees