Research Scientist / Engineer — Foundation Model (Agent)

Luma • Redwood City, CA

7d

About The Position

You'll build and train large-scale multimodal agentic models — systems that reason, plan, code, and call tools to do complex, multi-step work over pixels. This is core research shaping how users interact with what Luma's models can do. It's a multi-stack research role across modeling, data, systems, and evaluation, on novel problems with no existing playbook, treating science and engineering as equally important. It fits someone grounded in foundation models and agentic systems who's trained models at real scale. If you want to work in only one layer of the stack, this deliberately spans several.

Requirements

• Strong foundation in machine learning, foundation models, and agentic systems.
• Deep understanding of agentic systems and LLM/VLM reasoning, coding models, and tool calling.
• Hands-on PyTorch and large-scale training (distributed, mixed precision, large datasets).

Nice To Haves

• Experience with state-of-the-art foundation models in reasoning, coding, or tool calling, or state-of-the-art multimodal agents.

Responsibilities

• Architect large-scale multimodal agentic models that use reasoning, planning, coding, and tool calling for complex, multi-step work.
• Design, build, and run robust data pipelines to construct, enrich, and filter massive pixel datasets, and formulate new tasks.
• Train large-scale multimodal models on massive datasets and GPU clusters.
• Define and build novel evaluation frameworks to measure multimodal agents.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed