Member of Technical Staff, Head of Quality

Plato • San Francisco, CA

7d • $180,000 - $280,000 • Hybrid

About The Position

Plato is an applied research lab building the foundational infrastructure to train specialized AI agents. We turn real-world data streams into high-fidelity simulated environments that generate the training signal needed to make capable models. Our work supports frontier labs, hyperscalers, and enterprises building AI systems for complex, high-stakes work. Today, only a handful of players can train models for capable work. Compute and algorithms are rapidly commoditizing, but reinforcement learning data remains the bottleneck. Plato is changing that by automatically scaling training environments from proprietary real-world data.

Requirements

• Have built automated evaluation, QA, or data quality systems for ML training data, agents, or large-scale pipelines.
• Have led or managed a team, and want to keep building while doing it.
• Have strong judgment about data: you can look at a sample and tell what is subtly wrong with it.
• Have experience with LLM agents, evals, RL environments, annotation pipelines, or human-in-the-loop review at scale.
• Are comfortable owning a standard, defending it under delivery pressure, and being accountable when quality slips.
• Care more about what a dataset actually teaches a model than about whether it passed a checklist.

Responsibilities

• Define the quality bar for environments, tasks, verifiers, rewards, and datasets, and turn it into something measurable rather than a matter of taste.
• Build automated QA systems and agents that validate environments end to end: replay rollouts, stress verifiers, detect reward hacking, and flag unrealistic or ungrounded tasks.
• Instrument quality telemetry and dashboards so regressions surface before a customer finds them.
• Own delivery acceptance for engagements with frontier labs, hyperscalers, and enterprises.
• Hire, onboard, and manage QA engineers, domain experts, and reviewers, and design the workflows they run.
• Partner with research and engineering to push quality checks upstream into generation, so fewer defects are ever created.
• Keep raising the bar as model capability moves and yesterday’s hard task becomes trivial.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed