Senior Technical Program Manager (TPM)

mpathic • Seattle preferred, WA

1d • $140,000 - $200,000 • Remote

About The Position

We’re looking for a Senior Technical Project Manager (TPM) who is also a licensed or clinically trained expert , with experience in AI safety, evaluation, or behavioral science research. This role is ~50% delivery leadership, ~50% clinical evaluation & quality. This role does not provide therapy, crisis intervention, or on-call clinical care In this role, you will lead end-to-end delivery of psychologically grounded AI safety evaluation projects, ranging from data generation to safety rubric development to red teaming—ensuring that advanced models respond appropriately when users discuss stressful life events, crises, trauma, daily hassles, and other sensitive experiences. You’ll operate at the intersection of: Clinical judgment AI evaluation rigor Annotation and rubric design Qualitative data analysis Operational excellence Cross-functional technical delivery This is a full-time, remote role (US preferred), reporting to the Head of AI Safety or Evaluation Programs/GM.

Requirements

• Have 5+ years of experience in one or more of: Technical project/program management and team leadership experience Clinical research experience and/or report writing Organize and analyze qualitative data, in addition to synthesizing key findings Train and coach clinicians to engage in high-level data analysis with the end goal of developing safety rubrics and evaluation systems Navigate evolving rubrics, edge cases, and judgment callsAI evaluation or annotation programs Trust & safety, human-centered AI, or behavioral science workflows
• Licensed clinician (LCSW, LMFT, PsyD, PhD, MD) or equivalent applied experience
• Expertise in qualitative data, annotation and/or evaluating clinical conversations for safety and mental health content
• Deep familiarity with psychological stress, trauma, crisis response, or mental health frameworks
• Ability to evaluate model behavior in emotionally complex, high-stakes conversations
• Designing rubrics that capture nuanced human and clinical judgment
• Running expert labeling efforts with calibration and reliability
• Translating ambiguous safety questions into structured evaluation plans
• Building scalable systems instead of relying on heroics
• Communicating clearly through specs, dashboards, and structured reporting
• Helping other clinicians apply shared standards

Responsibilities

• Own Clinically Grounded AI Evaluation Delivery (Core)
• Lead evaluation projects from kickoff → rubric → execution → QA → final reporting
• Define milestones, timelines, and delivery SLAs
• Manage delivery risk in sensitive, high-stakes domains
• Ensure outputs are rigorous, clinically appropriate, and customer-ready
• Evaluate safety, appropriateness, and response quality—not clinical outcomes
• Familiarity with scope, limits, and responsible handling of sensitive content
• Design Rubrics & Annotation Protocols
• Partner with mpathic behavioral experts to define rating criteria
• Build labeling guides for psychological state, intent, appropriateness, and harm risk
• Ensure rubrics balance clinical nuance with operational usability
• Drive Quality & Calibration Systems
• Implement review tiers: peer review → QA → escalation
• Run inter-rater reliability and disagreement reduction workflows
• Maintain gold sets and drift monitoring over time
• Tooling & Workflow Ownership
• Translate evaluation needs into requirements for internal tooling: Work queues and labeling interfaces Audit trails and version control Taxonomies for stress, crisis, and safety response categories Reporting automation and reproducibility pipelines
• Metrics & Operational Excellence
• Own evaluation program dashboards including: Throughput per expert per day Agreement and defect rates Cycle time and on-time delivery Safety actionability metrics (e.g., customer acceptance, mitigation impact)
• Customer & Stakeholder Execution Support
• Help scope clinically sensitive evaluation engagements
• Translate customer priorities into clear execution plans
• Present findings with clinical and operational clarity

Benefits

• We offer 100% company-funded health, dental, and vision insurance for full-time employees.
• Additionally, we offer 401k, well-being programs, and flexible paid-time off.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: Ph.D. or professional degree