Member of Technical Staff - ML Infra

Causal Labs•San Francisco, CA

About The Position

The Member of Technical Staff - ML Infra designs, deploys, and maintains large distributed machine learning training and inference clusters. The role develops efficient, scalable end-to-end pipelines for managing petabyte-scale datasets and model training across the ML lifecycle. It also researches and tests training approaches, including parallelization techniques and numerical precision trade-offs at different model scales, and analyzes, profiles, and debugs low-level GPU operations to improve performance. The successful candidate stays current with research and brings new ideas to the work. The team values persistent problem-solving, rapid execution, and the ability to learn quickly in unfamiliar domains.

Requirements

  • Strong grasp of state-of-the-art techniques for optimizing training and inference workloads.
  • Demonstrated proficiency with distributed training frameworks such as FSDP or DeepSpeed for training large foundation models.
  • Knowledge of cloud platforms such as GCP, AWS, or Azure and their ML/AI service offerings.
  • Familiarity with containerization and orchestration frameworks such as Kubernetes and Docker.
  • Background working on distributed task management systems and scalable model serving and deployment architectures.
  • Understanding of monitoring, logging, observability, and version control best practices for ML systems.
  • A persistent approach to problem-solving, rapid execution, and the ability to learn quickly in unfamiliar domains.

Responsibilities

  • Design, deploy, and maintain large distributed ML training and inference clusters.
  • Develop efficient, scalable end-to-end pipelines to manage petabyte-scale datasets and model training throughout the ML lifecycle.
  • Research and test training approaches, including parallelization techniques and numerical precision trade-offs across different model scales.
  • Analyze, profile, and debug low-level GPU operations to optimize performance.
  • Stay up to date on research and bring new ideas to the work.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service