Mental Health Contractor

Flagship Pioneering, Inc.•Cambridge, MA

4h•Remote

About The Position

FL105 is seeking a mental health professional for a flexible, part-time contract role to help shape how AI systems understand and respond to vulnerable users. This position focuses on ensuring AI systems are safe, reliable, and impactful by working at the intersection of clinical expertise and AI development. The contractor will collaborate with researchers, engineers, and product teams on high-impact initiatives involving the evaluation, safety, and training of large language models (LLMs).

Requirements

Graduate-level training in a relevant field (e.g., psychology, psychiatry, social work, counseling, or related)
Meaningful clinical experience across a range of mental health presentations
Strong grounding in risk assessment, clinical decision-making, and ethics
Comfort engaging with sensitive or ambiguous content
Excellent written communication and attention to detail
Familiarity with AI systems or large language models (LLMs)

Nice To Haves

Licensure
Experience with severe or complex mental health conditions, couples, and/or families
Background in data annotation/labeling, content review, or structured evaluation workflows
Experience developing rubrics, guidelines, or clinical frameworks
Experience with trust & safety, policy development, or QA processes

Responsibilities

Evaluate AI Outputs: Assess responses for quality and safety
Data Annotation: Review and label conversations or datasets using structured guidelines
Develop Rubrics & Frameworks: Create evaluation criteria and scoring guidelines
Red Teaming & QA: Identify model failures
Scenario Design: Develop realistic conversations to test model performance
Expert Feedback: Partner with cross-functional teams to iteratively improve system behavior, advise on safety and other quality standards