Psychiatry Expert

Weekday AI

3h•Remote

About The Position

We are seeking board-certified psychiatrists to support an expert evaluation project with a leading AI research organization. The project focuses on assessing how effectively advanced AI systems reason through complex psychiatric scenarios. As a Psychiatry Expert, you will use your clinical expertise to develop challenging, expert-level diagnostic and reasoning tasks, establish authoritative reference answers, and identify common weaknesses in AI-generated clinical reasoning. Psychiatrists from a range of practice settings are welcome, with particular interest in professionals with specialized expertise in psychiatry subspecialties.

Requirements

Completed psychiatry residency through an ACGME, AOA, or recognized national-equivalent program. Current trainees do not qualify.
Medical degree: MD or DO. International medical degrees from recognized institutions are also eligible.
Active board certification in psychiatry, such as: ABPN, FRCPC, MRCPsych, FRANZCP, or recognized national equivalent. Board-eligible or lapsed certifications do not meet the requirement.
Active, unrestricted medical license with no current suspension, revocation, or open disciplinary action.
3+ years of independent clinical practice after residency, either currently or within the past two years. Residency and fellowship training do not count toward this requirement.
Current or recent practice in an accredited or government-licensed clinical setting, including hospitals, academic medical centers, community clinics, private practices, or telehealth organizations.
Must be based in the United States, United Kingdom, Europe, or Australia. US-based candidates are preferred.
Psychiatry must be the primary area of professional practice.

Nice To Haves

10+ hours per week of direct patient care, currently.
Specialized expertise in one or more of the following areas: Addiction Psychiatry, Child & Adolescent Psychiatry, Forensic Psychiatry, Geriatric Psychiatry, Consultation-Liaison Psychiatry.
Subspecialty expertise demonstrated through a fellowship, subspecialty board certification, or at least two years of relevant clinical practice.
Experience developing or administering OSCEs, including examiner or assessment-development experience.
Current or recent faculty appointment within a psychiatry department.
Experience reviewing, evaluating, grading, or developing clinical or medical educational content.

Responsibilities

Develop expert-level psychiatric cases and reasoning challenges designed to test advanced AI systems.
Create accurate, clinically rigorous, gold-standard answers supported by clear diagnostic and clinical reasoning.
Evaluate nuanced psychiatric scenarios, including complex differentials, edge cases, and risk-assessment considerations.
Review AI-generated responses and identify clinical inaccuracies, reasoning gaps, unsupported conclusions, and common failure patterns.
Provide structured feedback to help research teams understand and improve AI performance on advanced psychiatric tasks.
Collaborate directly with AI research teams and other subject-matter experts.
Apply current clinical knowledge and professional judgment consistently when evaluating model outputs.
Develop clinically challenging psychiatric scenarios for AI evaluation.
Produce authoritative answers with transparent and well-structured clinical reasoning.
Focus on nuanced differentials, psychiatric risk assessment, diagnostic uncertainty, and clinical edge cases.
Evaluate model responses for clinical accuracy, reasoning quality, and appropriate judgment.
Identify recurring failure modes in AI reasoning and communicate them clearly to research teams.
Collaborate with other psychiatric and clinical experts to maintain consistent evaluation standards.