Psychiatry Specialist (Contract)

mpathic

38d

About The Position

We're looking for experienced psychiatrists to help evaluate and improve the next generation of large language models by testing how they reason through complex psychiatric cases. In this role, you'll create challenging, clinically realistic scenarios that push AI beyond straightforward textbook knowledge. You'll identify where models break down, develop expert reference answers grounded in evidence-based psychiatric practice, and provide structured feedback that directly improves model performance. Your expertise will help shape safer, more reliable AI for healthcare.

Requirements

• MD, DO, or internationally equivalent medical degree.
• Completion of an accredited psychiatry residency (ACGME, AOA, or recognized international equivalent).
• Current board certification in Psychiatry (ABPN, FRCPC, MRCPsych, FRANZCP, or recognized national equivalent).
• Current, active, unrestricted medical license with no suspension, revocation, or ongoing disciplinary action.
• At least 3 years of independent clinical practice following residency (training years excluded), either currently practicing or having practiced within the past two years.
• Experience practicing in an accredited or government-licensed healthcare setting, including hospitals, academic medical centers, community mental health clinics, private practice, or telepsychiatry.

Nice To Haves

• Currently providing at least 10 hours of direct patient care per week.
• Advanced expertise in Addiction Psychiatry, Child & Adolescent Psychiatry, Consultation-Liaison Psychiatry, Forensic Psychiatry, Geriatric Psychiatry, or another recognized psychiatry subspecialty through fellowship training, subspecialty board certification, or at least two years of focused clinical practice.
• Experience developing or examining Objective Structured Clinical Examinations (OSCEs).
• Passion for improving AI systems and advancing the future of responsible healthcare technology.

Responsibilities

• Design clinically realistic prompts and case scenarios based on your psychiatry practice, including diagnostic formulation, medication management, psychotherapy, risk assessment, capacity evaluation, and complex clinical decision-making.
• Evaluate AI-generated responses using structured rubrics for accuracy, safety, completeness, and clinical judgment.
• Identify nuanced edge cases, challenging differential diagnoses, and common model failure modes to improve AI reasoning.
• Collaborate with researchers at a leading AI lab to advance the performance and reliability of healthcare AI systems.
• Provide detailed written feedback that informs future model training and evaluation.
• Participate in onboarding, calibration sessions, and ongoing quality reviews.

What This Job Offers

• Career Level: Senior
• Education Level: Ph.D. or professional degree