About The Position

Preference Model is a superintelligence data research company that builds reinforcement learning (RL) environments for training capable, better-aligned AI systems. The company researches how to improve RL environments and training objectives, and has built environments for several frontier labs. Its founding team previously worked on Anthropic’s data team, and the company is backed by $16M in seed funding led by a16z. The role focuses on investigating self-directed learning and advancing post-training for large language models. It blends research and engineering: the successful candidate will implement novel approaches, contribute to research direction, train and evaluate models, and build and optimize RL training systems and environments.

Requirements

  • Industry experience running end-to-end LLM post-training pipelines for models of at least 7B parameters.
  • Proficiency in Python and PyTorch or JAX.
  • Experience with at least one modern RL training framework.
  • Experience building and operating ML infrastructure at scale.

Nice To Haves

  • Experience evaluating model outputs and building reward or evaluation signals.
  • Keeps current with post-training research and can translate papers into running code.
  • Strong, adaptable opinions about structuring RL training code for reproducibility and fast iteration.
  • Ability to balance research exploration with engineering rigor.
  • Strong systems design and communication skills.
  • Adaptability and exceptional communication and collaboration skills.

Responsibilities

  • Train and evaluate models on proprietary RL environments to validate data quality, identify gaps in task coverage, and connect environment design with model capability.
  • Architect and optimize RL training infrastructure, including training abstractions and distributed experiment management, using frameworks such as Verl, OpenRLHF, or similar.
  • Scale systems to support increasingly complex research workflows.
  • Design, implement, and test training environments, evaluations, and methodologies for RL agents.
  • Profile and optimize training runs end-to-end, from data loading through reward computation, to maximize experiment throughput and shorten research iteration cycles.

Benefits

  • Competitive cash and equity compensation (above the 90th percentile).
  • Ownership and autonomy in a fast-moving startup environment.
  • Opportunity to work with top machine learning engineers.
  • Health, vision, and dental benefits.
  • 401(k) match.
  • Lunch provided every day onsite.
  • Weekly snack orders.
  • Visa sponsorship and relocation support available.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service