Member of Technical Staff - ML Platform Engineer

Preference Model•San Francisco, CA
•$180,000 - $350,000

About The Position

Preference Model is a superintelligence data research company that builds reinforcement-learning environments for training capable, better-aligned AI systems. The company researches ways to improve RL environments and has built environments for several frontier labs. It is backed by $16M in seed funding led by a16z. As a Member of Technical Staff on the ML Platform team, you will own the systems that move an environment from a builder's repository to a partner lab's training run. This includes Karotte, the company's open-source framework for defining RL environments; an internal platform for building, running, and reviewing environments on CPU, GPU, and TPU; and integrations for delivering environments to partner labs. The role focuses on making environment delivery reliable and automated, and ensuring work from the Capabilities team runs and ships cleanly. You will work on a small Platform team alongside environment builders and post-training researchers. The stated first-six-month goal is a mostly automated delivery path to each partner lab, where tasks marked ready are built, validated against lab requirements, and packaged without manual work. The role may also take on other platform and infrastructure priorities as needs change.

Requirements

  • At least 5 years of experience building and owning ML platform engineering, ideally in AI-related ML platform engineering.
  • Strong software engineering fundamentals and a track record of building and operating production infrastructure or developer platforms used by other engineers.
  • Hands-on experience with containers and orchestration, such as Docker, Kubernetes, or similar.
  • Experience with at least one major cloud platform, such as GCP, AWS, or similar.
  • Working understanding of safely running untrusted code, including isolation, resource limits, and handling processes that fill disks or refuse to exit.
  • Experience owning a tedious process end to end, such as a migration, release process, or delivery pipeline, and automating as much of it as possible.
  • Extensive hands-on use of coding agents such as Claude Code, Cursor, Codex, or similar, and an intuition for where models cut corners.
  • Proficiency in Python, including writing libraries and APIs for others to use.

Nice To Haves

  • Experience building RL environments, evaluation harnesses, or agent benchmarks such as Terminal-Bench or SWE-bench.
  • Familiarity with RL post-training and inference stacks such as verl, Ray, SkyPilot, vLLM, or SGLang.
  • Experience building sandbox or code-execution infrastructure, such as microVMs using Firecracker or gVisor, at an infrastructure startup or frontier lab.
  • Experience as an early platform or infrastructure engineer at a startup, building an internal platform used by the rest of engineering.
  • Experience as a forward-deployed or integrations engineer, deploying company software in customers' environments.
  • Experience building developer tooling or internal platforms used by ML researchers.
  • Experience maintaining an open-source developer framework with external users.

Responsibilities

  • Own integrations for delivering environments to partner labs, including building container images, matching lab submission formats, and automating pre-delivery requirement checks.
  • Perform delivery work manually when necessary and automate it where possible.
  • Build and maintain Karotte, the open-source environment framework, including API design, releases, and migrations that keep existing environments working.
  • Run and scale infrastructure for building, running, and grading environments across CPU, GPU, and TPU.
  • Implement containerized rollouts, VM-based sandboxing, resource limits, and isolation to prevent models from gaming their graders.
  • Build internal tools used by environment builders, including a CLI, documentation, data catalog, access controls, and run monitoring.
  • Work with environment builders and post-training researchers to turn recurring pain points into platform features.
  • Respond to user feedback and ship platform improvements quickly.

Benefits

  • Competitive cash and equity compensation above the 90th percentile.
  • Ownership and autonomy in a fast-moving startup environment.
  • Opportunity to work alongside senior and staff engineers from frontier labs and infrastructure companies, as well as top ML engineers.
  • Health, vision, and dental benefits.
  • 401(k) match.
  • Lunch provided every day onsite.
  • Weekly snack orders.
  • Visa sponsorship and relocation support available.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service