Software Engineer, Frameworks & Libraries

Thinking Machines Lab•San Francisco, CA
•$300,000 - $400,000•Onsite

About The Position

Thinking Machines is hiring a Software Engineer, Frameworks & Libraries to turn internal functionality into open-source core libraries for the community. The role packages code that powers model launches and the Tinker Cookbook into well-designed, well-documented libraries, enabling researchers and developers to sample from, post-train, and evaluate new models from day one. The engineer will own the path from internal prototype to public library across the stack of model-interaction primitives. They will design stable, composable interfaces that can adapt as models and training methods change and work reliably for Tinker customers. The role is technical-first and sits at the boundary of research, infrastructure, and the open-source community, with an emphasis on API design, backwards compatibility, and developer experience. The position is based in San Francisco, California, or New York, New York. The expected annual salary range is $300,000–$400,000 USD, depending on background, skills, and experience. Thinking Machines sponsors visas and offers benefits including health, dental, and vision benefits, unlimited PTO, paid parental leave, and relocation support as needed.

Requirements

  • At least 4 years of professional software engineering experience, including building and maintaining libraries or SDKs used by other developers.
  • Strong Python skills, including typing, packaging, dependency management, testing, and CI.
  • Experience designing public APIs and managing versioning, backwards compatibility, and deprecations.
  • Working understanding of how large language models are trained and sampled, including tokenization, chat formats, and tool calling.
  • Ability to work autonomously across research and engineering teams and turn ambiguous, internal-facing code into a polished public release.

Nice To Haves

  • Experience maintaining open-source libraries, especially in the machine learning ecosystem, such as PyTorch, Hugging Face, or similar projects.
  • Hands-on experience with LLM post-training, including supervised fine-tuning and reinforcement learning, and the data and rollout pipelines that support them.
  • Experience building agent or rollout infrastructure, such as sandboxed runtimes, long-context management or compaction, session and state handling, or evaluation harnesses.
  • Experience building developer tools for inspecting model behavior, such as trace or transcript viewers.
  • Familiarity with building graders, reward functions, or evaluation frameworks for language models.
  • Experience with performance-sensitive code, such as streaming parsers or Rust or C++ extensions exposed to Python.
  • Strong opinions about developer experience, documentation, and examples, and a record of public code, tutorials, or writing that helped others apply technical concepts.

Responsibilities

  • Package internal functionality into external open-source core libraries and maintain them with clear versioning, changelogs, deprecation policies, and release automation.
  • Support model launches by ensuring renderers, tokenizers, parsers, and tool-call handling for new models are ready for sampling and post-training.
  • Design and build stack layers following the renderer, including context compaction, session management, the rollout loop and runtime, a rollout viewer, and graders.
  • Contribute to the Tinker Cookbook by creating reference recipes and examples demonstrating best practices for supervised and reinforcement learning.
  • Define clean, composable, typed APIs between libraries and maintain compatibility among the Cookbook, Tinker SDK, and internal training and inference systems.
  • Build testing, benchmarking, and correctness tools, including token-level parity tests against reference implementations.
  • Partner with research, infrastructure, and product teams to identify internal code suitable for open source and prioritize what to generalize.
  • Engage with the open-source community by triaging issues, reviewing contributions, and incorporating user feedback.

Benefits

  • Generous health benefits.
  • Dental benefits.
  • Vision benefits.
  • Unlimited PTO.
  • Paid parental leave.
  • Relocation support as needed.
  • Visa sponsorship.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service