Software Engineer, Data Infrastructure

Thinking Machines Lab•San Francisco, CA
•$300,000 - $400,000•Onsite

About The Position

Thinking Machines is hiring an engineer to contribute to data infrastructure on a small, high-impact team. The team architects and scales the core infrastructure behind distributed training pipelines, multimodal data catalogs, and intelligent processing systems operating over petabytes of data. The role involves working directly with researchers to accelerate experiments, develop datasets, improve infrastructure efficiency, and enable insights across data assets. The engineer will build and operate scalable infrastructure for LLM research, including distributed compute, data orchestration, and storage across modalities. The work also includes developing high-throughput data systems and lifecycle capabilities, and supporting platform reliability and performance. The position is based in San Francisco, California, or New York, New York. The expected annual salary range is $300,000–$400,000 USD, depending on background, skills, and experience. Visa sponsorship is available, though success is not guaranteed.

Requirements

  • Bachelor’s degree or equivalent experience in computer science, engineering, or a similar field.
  • Proficiency in at least one backend language; the company uses Python or Rust.
  • Fluency in distributed compute frameworks such as Apache Spark or Ray.
  • Deep familiarity with cloud infrastructure, data lake architectures, and batch and streaming pipelines.
  • Ability to operate across the stack and own projects end-to-end.
  • Ability to thrive in a highly collaborative environment involving cross-functional partners and subject matter experts.
  • Bias for action and initiative to work across stacks and teams to help ensure projects ship.

Nice To Haves

  • Hands-on experience with Kafka, dbt, Terraform, and Airflow.
  • Experience building a web crawler.
  • Extensive experience understanding and scaling deduplication, data mining, and search.
  • Strong knowledge of file formats and storage systems such as Parquet and Delta Lake, and their impact on performance and scalability.
  • Proactive approach to documentation, testing, and empowering teammates with good tooling.

Responsibilities

  • Design, build, and operate scalable, fault-tolerant infrastructure for LLM research, including distributed compute, data orchestration, and storage across modalities.
  • Develop high-throughput systems for data ingestion, processing, and transformation, including training data catalogs, deduplication, quality checks, and search.
  • Build systems for traceability, reproducibility, and robust quality control at every stage of the data lifecycle.
  • Implement and maintain monitoring and alerting to support platform reliability and performance.
  • Collaborate with research teams to unlock new features, improve data quality, and accelerate training cycles.

Benefits

  • Health benefits
  • Dental benefits
  • Vision benefits
  • Unlimited PTO
  • Paid parental leave
  • Relocation support as needed
  • Visa sponsorship
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service