Technical Program Manager, External Evaluators

Anthropic•San Francisco, CA
•$290,000 - $365,000•Hybrid

About The Position

Anthropic is hiring a Technical Program Manager to establish and deepen partnerships with independent external reviewers and embedded evaluators, supporting a thriving frontier evaluation ecosystem. The role owns the external evaluator program end to end: maintaining existing relationships, expanding the portfolio of partner organizations, and managing evaluators from initial conversations through scoping, contracting, onboarding, access, review, and publication. The position will scale the program’s manual processes into systems that can support multiple evaluators while coordinating across Safety, Research, Security, Legal, People Services, IT, Policy, and Communications. The Technical Program Manager will work with researchers and engineers to define the access, tooling, evidence, data, and compute needed for evaluations, while balancing evaluator access with the protection of customers, security, and confidential information. The role also drives report review, turns technical findings into accountable research and engineering work, builds program tooling with engineering teams, and iterates on program policies and practices.

Requirements

  • Experience leading complex technical programs with engineering or research teams from ambiguous goals through delivery.
  • Experience managing relationships with external organizations, including scoping work, navigating contracting, setting expectations, and resolving disagreements.
  • Strong program management skills, including program planning, milestone and dependency tracking, and risk management across concurrent workstreams.
  • Technical fluency in how frontier AI models are trained, evaluated, and monitored, sufficient to define technical requirements, identify technical risks, and challenge tradeoffs with researchers and engineers.
  • Sound judgment and discretion with confidential and sensitive information.
  • A bachelor’s degree or an equivalent combination of education, training, and/or experience.
  • A field of study relevant to the role, as demonstrated through coursework, training, or professional experience.

Responsibilities

  • Own the external evaluator program end to end, including relationships with evaluator organizations and the pipeline of future partners.
  • Guide each evaluator from first conversation through scoping, contracting, onboarding, access, review, and publication of a report.
  • Define stages and tiers for working with evaluators and develop information access policies that meet evaluator needs while protecting security and confidential information.
  • Drive evaluator access and information requests to fast, well-documented decisions in partnership with Research, Security, Legal, and IT.
  • Drive the technical design of evaluator access with Security, IT, and infrastructure teams, including permissions, environments, and monitoring; address gaps between policy and technical controls without slowing evaluators down.
  • Run the evaluator report review process against agreed timelines and redaction criteria while protecting evaluators’ ability to publish their own conclusions.
  • Scope evaluations with researchers and engineers, translate evaluator questions about training, monitoring, and alignment into concrete requirements for model access, data, tooling, and compute, and plan capacity for each new evaluator.
  • Translate evaluators’ technical findings into research and engineering work with owners and dates, and drive accountability for Anthropic’s responses.
  • Keep the company informed with regular program updates and clear guidance on working with evaluators.
  • Collect feedback from evaluators and internal teams, run retrospectives, and iterate on policies and practices.
  • Use Claude and work with engineering teams to build program tooling, such as access provisioning, request tracking, and report review.
  • Support a thriving evaluator ecosystem by sharing lessons about running independent evaluations.

Benefits

  • Competitive compensation and benefits
  • Optional equity donation matching
  • Generous vacation and parental leave
  • Flexible working hours
  • Office space for collaboration
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service