About The Position

Preference Model is a superintelligence data research company that builds reinforcement-learning environments for training capable, better-aligned AI systems. The company focuses on improving training objectives and has built RL environments for several frontier labs. It is backed by $16 million in seed funding led by a16z; its founding team has experience building data infrastructure and datasets at Anthropic. The role focuses on building the infrastructure and systems that power frontier post-training research on large language models. The engineer will develop scalable, high-throughput infrastructure and help shape how research is conducted, enabling further progress in self-directed learning.

Requirements

  • Strong software engineering fundamentals.
  • Hands-on experience building production-grade LLM inference and training infrastructure, ideally from the ground up.
  • Experience with LLM training and inference internals, such as transformers and distributed training, and inference libraries such as vLLM, SGLang, or Megatron.
  • Experience with RL training frameworks such as Slime, veRL, Ray Train, SkyRL, or Miles.
  • Significant understanding of distributed systems principles and hands-on experience with cloud platforms such as AWS or GCP and container orchestration such as Kubernetes.
  • Experience building systems for high-throughput, low-latency workloads.
  • Experience with data engineering tools and building robust, scalable data pipelines.
  • Proficiency in core ML frameworks such as PyTorch or JAX.
  • Ability to balance production rigor with fast-moving research and clearly communicate infrastructure tradeoffs to researchers who are not infrastructure specialists.

Responsibilities

  • Design, build, and scale the compute, scheduling, and data infrastructure that powers post-training research on in-house RL environments.
  • Develop and maintain core ML framework primitives and internal tools used by researchers to accelerate reproducible experimentation and reduce the time from idea to result.
  • Build evaluation and benchmarking infrastructure, monitoring, logging, debugging tools, and automated testing and deployment systems.
  • Partner with Research Engineers to translate research needs into infrastructure requirements and deliver improvements in response to their feedback.

Benefits

  • Competitive cash and equity compensation above the 90th percentile.
  • Ownership and autonomy in a fast-moving startup environment.
  • Opportunity to work alongside senior and staff engineers from frontier labs and infrastructure companies, as well as top ML engineers.
  • Health, vision, and dental benefits.
  • 401(k) match.
  • Lunch provided every day onsite.
  • Weekly snack orders.
  • Visa sponsorship and relocation support available.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service