Software Engineer, Distributed Systems

Thinking Machines Lab•San Francisco, CA
•$300,000 - $400,000

About The Position

Thinking Machines is hiring a Software Engineer, Distributed Systems to design and build the core distributed systems that support its products and infrastructure, including orchestration, scheduling, storage, and networking across thousands of machines. The work underpins Inkling's training clusters and Tinker's serving platform, as well as other systems that need to coordinate reliably at scale. This is deep systems work involving consensus, fault tolerance, and performance under real-world failure conditions, including challenges without off-the-shelf solutions. The engineer will partner with research and infrastructure teams to identify bottlenecks, develop first-principles solutions, write production-quality code, and help shape company-wide system architecture.

Requirements

  • At least 5 years of experience building large-scale distributed systems.
  • Proficiency in Python and Go, C++, or another systems-level language.
  • Strong understanding of distributed systems fundamentals, including consensus, consistency, replication, and fault tolerance.
  • Experience with network programming, load balancing, or distributed storage systems.

Nice To Haves

  • Experience building distributed compute or orchestration systems for AI or ML workloads.
  • Fluency in containerization, orchestration, and distributed compute frameworks.
  • Experience with specialized hardware such as GPUs or TPUs and its integration into distributed training or serving systems.
  • Background at AI research labs, high-performance computing centers, or similarly demanding environments.
  • Published work or open-source contributions related to distributed systems or performance engineering.
  • Comfort operating with high autonomy in a fast-changing, early-stage environment.

Responsibilities

  • Design and build distributed systems for compute orchestration, scheduling, storage, and networking across large GPU and TPU clusters.
  • Develop fault-tolerant systems that operate correctly as hardware fails, networks partition, and workloads scale.
  • Build distributed storage and data orchestration layers to move and persist large volumes of training and model data.
  • Improve the performance and efficiency of collective communication, scheduling, and resource allocation across thousands of machines.
  • Partner with research and infrastructure teams to identify systems bottlenecks and design solutions from first principles.
  • Write production-quality code and help shape the architecture of systems used company-wide.

Benefits

  • Generous health benefits.
  • Dental benefits.
  • Vision benefits.
  • Unlimited PTO.
  • Paid parental leave.
  • Relocation support as needed.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service