Technical Program Manager, External Evaluators

Anthropic•San Francisco, NY
•Hybrid

About The Position

Anthropic is hiring a Technical Program Manager to establish and deepen partnerships with external reviewers and embedded evaluators who assess its models, safety practices, processes, and policies. The role owns the external evaluator program from partner relationships and pipeline development through scoping, contracting, onboarding, access, report review, and publication. The program manager will evolve manual processes into systems that support many evaluators at once, working across Safety, Research, Security, Legal, People Services, IT, Policy, Communications, and infrastructure teams. The role requires technical depth to define the access, tooling, evidence, data, and compute needed for evaluations, alongside sound judgment about balancing evaluator access with protection of customers, security, and confidential information. The successful candidate will make most decisions quickly and independently, escalating only those that require it. Within six months, they should be able to take a new evaluator from contract negotiation to a first published report with minimal senior-leader involvement. They will also use Claude and collaborate with engineering teams to build program tooling, turn evaluator findings into research and engineering work, and share lessons that support a thriving independent-evaluation ecosystem.

Requirements

  • Experience leading complex technical programs with engineering or research teams from ambiguous goals through delivery.
  • Experience managing relationships with external organizations, including scoping work, navigating contracting, setting expectations, and resolving disagreements.
  • Strong program management skills, including program planning, milestone and dependency tracking, and risk management across concurrent workstreams.
  • Technical fluency in how frontier AI models are trained, evaluated, and monitored, sufficient to define technical requirements, identify technical risks, and challenge tradeoffs with researchers and engineers.
  • Sound judgment and discretion with confidential and sensitive information.
  • Bachelor’s degree or an equivalent combination of education, training, and/or experience.
  • A field of study relevant to the role, demonstrated through coursework, training, or professional experience.

Responsibilities

  • Own the external evaluator program end to end, including relationships with evaluator organizations and the pipeline of future partners.
  • Guide each evaluator from first conversation through scoping, contracting, onboarding, access, review, and publication of a report.
  • Define stages and tiers for working with evaluators and develop information-access policies that meet evaluators’ needs while protecting security and confidential information.
  • Drive fast, well-documented decisions on evaluator access and information requests with Research, Security, Legal, and IT.
  • Lead the technical design of evaluator access with Security, IT, and infrastructure teams, including permissions, environments, and monitoring; close gaps between policy and technical controls without slowing evaluators down.
  • Manage review of evaluator reports against agreed timelines and redaction criteria while protecting evaluators’ ability to publish their own conclusions.
  • Scope evaluations with researchers and engineers by translating evaluator questions about training, monitoring, and alignment into requirements for model access, data, tooling, and compute, and plan capacity for each evaluator.
  • Translate evaluators’ technical findings into research and engineering work with owners and deadlines, and drive accountability for Anthropic’s response.
  • Keep the company informed through regular program updates and clear guidance on working with evaluators.
  • Collect feedback from evaluators and internal teams, run retrospectives, and improve policies and practices.
  • Use Claude and work with engineering teams to build program tooling, such as access provisioning, request tracking, and report review systems.
  • Share lessons about running independent evaluations to support a thriving evaluator ecosystem.

Benefits

  • Competitive compensation and benefits.
  • Optional equity donation matching.
  • Generous vacation and parental leave.
  • Flexible working hours.
  • Office space for collaboration.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service