Machine Learning Research Scientist: Generative Modeling for Planning

Nuro•Mountain View, CA

51d

About The Position

Develop and scale state-of-the-art generative models—especially diffusion architectures, flow-matching techniques, and energy-based models —for autonomous plan generation. Build generative models with foundation models. Leverage large language models and world foundation models for reasoning, decision making and multi-modality generation. Optimize generative models using reinforcement learning to improve interactive reasoning. Explore reward modeling/learned verifier using generative models. Explore joint prediction and planning and self-play. Leverage generative models for active learning and world modeling. Develop controllable generative models to guide the generation process towards desired goals, conditions and rewards. Collaborate across autonomy teams while developing holistic solutions to top autonomy challenges. Understand issues, propose ideas, prioritize work and develop solutions to solve them, evaluate your solution by deploying the models on to the NuroDriver.

Requirements

You have deep expertise and prior experience in some or many of the following areas:
You have a Ph.D. (preferable) or M.Sc. with 2-3 years of experience working with generative models in the lab, in industry, or both.
Research experiences in generative models, particularly diffusion models, flow matching and energy-based models, for robotics, including manipulation, path planning, and autonomous driving.
You have strong problem solving and programming skills in Python and/or C++
Strong culture fit and good team player.
Demonstrated research publications in top conferences (e.g. NeurIPS, ICLR, ICML, CVPR, RSS, CoRL etc.)

Nice To Haves

Experiences in vision-language-action models, reinforcement learning for generative model optimization, video generation, text-to-image generation, diffusion models for LLMs, world foundation models, and other applications of generative modeling are a bonus!

Responsibilities

Develop and scale state-of-the-art generative models for autonomous plan generation.
Build generative models with foundation models.
Leverage large language models and world foundation models for reasoning, decision making and multi-modality generation.
Optimize generative models using reinforcement learning to improve interactive reasoning.
Explore reward modeling/learned verifier using generative models.
Explore joint prediction and planning and self-play.
Leverage generative models for active learning and world modeling.
Develop controllable generative models to guide the generation process towards desired goals, conditions and rewards.
Collaborate across autonomy teams while developing holistic solutions to top autonomy challenges.
Understand issues, propose ideas, prioritize work and develop solutions to solve them, evaluate your solution by deploying the models on to the NuroDriver.