Research Engineer

Taste Labs • San Francisco, CA

1d

About The Position

Taste Labs is building data and infrastructure for measuring and teaching taste, beginning with design. The company develops post-training data and reinforcement-learning environments for frontier models, along with context and verification tools that help AI agents produce more creative, on-brand work.

The Research Engineer will own full-stack machine-learning research experiments, including training runs, infrastructure, data and evaluation pipelines, and publishing results. The role involves developing internal research, evaluation design, judges, and reward models, and collaborating directly with AI labs on frontier projects.

Requirements

• Experience in post-training and evaluations or judges.
• LLM experience is required; experience cannot be purely in classical machine learning.
• Think like a researcher and move like an engineer.
• Be creative, scrappy, and comfortable with ambiguity.
• Have a deep passion for creativity and design.

Nice To Haves

• Startup experience is strongly preferred.

Responsibilities

• Train reward models, classifiers, judges, and verifiers for subjective domains such as design, writing, and visual style.
• Develop frontier evaluations and benchmarks for subjective domains.
• Run post-training experiments on open-source models to test new data formats and post-training techniques.
• Set up the infrastructure needed to run experiments.
• Collaborate with AI labs and creative experts to design pilots and experiments around taste.
• Own the end-to-end pipeline.
• Publish blogs and whitepapers.

What This Job Offers

• Job Type: Full-time
• Education Level: No Education Listed