Software Engineer, Systems ML: PyTorch Distributed

Meta•Menlo Park, CA
•$121,992 - $181,000

About The Position

As a member of Meta’s PyTorch Distributed team, you will help develop the open-source software stack that powers AI models and systems. The team builds foundational infrastructure, APIs, kernels, tools, and recipes for fast and reliable distributed training in PyTorch and TorchTitan, a PyTorch-native framework for LLM pretraining and post-training. You will work closely with AI researchers and infrastructure engineers at Meta and in the open-source community to optimize distributed training using PyTorch.

Requirements

  • Currently have or be in the process of obtaining a bachelor’s degree in Computer Science, Computer Engineering, a relevant technical field, or equivalent practical experience; the degree must be completed before joining Meta.
  • Proven Python programming skills.
  • Experience in AI framework development or accelerating deep learning models on hardware architectures.

Nice To Haves

  • Experience adhering to and implementing responsible, ethical AI practices, such as risk assessment, bias mitigation, and quality and accuracy reviews.
  • Knowledge of GPU, CPU, or AI hardware accelerator architectures.
  • Experience with frameworks such as PyTorch, Caffe2, TensorFlow, ONNX, or TensorRT.
  • Demonstrated ongoing AI skill development, such as prompt or context engineering and agent orchestration, and staying current with emerging AI technologies.
  • For AI high-performance kernels: experience with CUDA, OpenMP, OpenCL, or AI hardware accelerator kernel programming; experience accelerating libraries on AI hardware, such as cuBLAS, cuDNN, CUTLASS, HIP, or ROCm.
  • For AI frameworks: experience developing training and inference framework components; experience with system performance optimization, including runtime analysis of latency, memory bandwidth, I/O access, and compute utilization, as well as related tooling development.
  • Demonstrated ability to integrate AI tools to optimize or redesign workflows and drive measurable impact, such as efficiency gains or quality improvements.

Responsibilities

  • Improve PyTorch’s state-of-the-art training, post-training, and inference on modern AI hardware accelerators.
  • Enable new models in TorchTitan for pretraining and post-training.
  • Optimize TorchTitan’s pretraining and post-training performance for the latest generative AI models.
  • Develop parallelism APIs, kernels, and tools for debugging and visualizing large distributed training jobs.
  • Build foundational distributed training infrastructure, including communication collectives, profiling, and memory allocation and management.

Benefits

  • Bonus
  • Equity
  • Benefits
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service