Software Engineer: ML Infra
About The Position
Generalist builds embodied foundation models for the physical world, with an initial focus on dexterity. The company combines AI and robotics to help robots intelligently interact with the physical world. Its team includes researchers, roboticists, and company builders with experience at frontier AI and robotics organizations. The Software Engineer: ML Infra will support training very large robot foundation models using large fleets of current-generation GPUs and infrastructure, currently Nvidia, for distributed training jobs and researcher experiments. The role includes addressing demanding storage and data-loading needs through cloud infrastructure and custom solutions, and owning inference infrastructure. Robot inference runs on fleets of on-premises GPUs attached to robots, under strict real-time and latency constraints in compute-constrained environments.
Requirements
- Experience managing large GPU fleets for large-scale, long-term, highly distributed training runs or inference.
- Deep experience with Slurm or Kubernetes for ML workload orchestration.
- Experience building high-scale ML data loaders and preparation systems.
- Deep understanding of every layer of the ML hardware, storage, and networking stacks.
- Experience in the Nvidia GPU ecosystem.
Responsibilities
- Own GPU compute fleets.
- Make GPUs easy for researchers to use and maximize their utilization.
- Optimize and improve ML data loading, transport, and storage in highly distributed, fully utilized environments.
- Orchestrate robot inference fleets.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Education Level
No Education Listed
