Research Engineer

Pantograph • San Francisco, CA

1d • Onsite

About The Position

Pantograph is training general models that start by watching internet-scale video and end up on robots. We think the path to capable robots runs through general intelligence rather than narrow, robot-specific skills. We're scaling simple methods across video games, real-world video, and our own fleet of affordable, durable robots. We're looking for a research engineer to help us train increasingly capable models across enormous and diverse datasets. You'll work across the boundary between research and engineering: implementing new ideas, scaling experiments across large GPU clusters, building the systems that let us iterate quickly, and figuring out why things aren't working. The work spans large-scale model training, multimodal representation learning, reinforcement learning, data processing, evaluation, and the infrastructure required to support all of it.

Requirements

• Trained models across large GPU clusters
• Comfortable working with Kubernetes
• Built or operated complex distributed systems
• Worked with multi-terabyte or multi-petabyte datasets
• Comfortable with large-scale data processing tools
• Care deeply about observability and collect enough metrics to understand what every part of a system is doing
• Comfortable moving between research code and production-quality systems
• Like running experiments, getting surprising results, and digging in until you understand why
• Move quickly and reach for simple approaches before complicated ones

Nice To Haves

• Experience with JAX
• Experience writing CUDA kernels or otherwise optimizing GPU workloads
• Low-level Linux or kernel programming experience
• Experience with large-scale video or multimodal datasets
• Experience building training or evaluation infrastructure
• Experience with distributed training
• Experience deploying models into real-world systems, especially robotics

Responsibilities

• Implementing new ideas
• Scaling experiments across large GPU clusters
• Building systems that allow for quick iteration
• Figuring out why things aren't working
• Large-scale model training
• Multimodal representation learning
• Reinforcement learning
• Data processing
• Evaluation
• Supporting infrastructure for all of the above

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed