Remote | Psychiatrist — Up to $140/hour

24-Mag • New York, NY

22h • Remote

About The Position

We are sharing a specialised part-time consulting opportunity for board-certified psychiatrists with substantial independent clinical experience and strong expertise in diagnostic reasoning, differential diagnosis, risk assessment, and complex psychiatric cases. This role supports an advanced AI research project focused on evaluating how large language models reason through challenging psychiatric scenarios. Selected psychiatrists will design expert-level clinical problems, develop authoritative reference answers, and identify important failure modes in AI-generated psychiatric reasoning.

Requirements

• Medical degree: MD, DO, or recognised international equivalent
• Completed psychiatry residency through ACGME, AOA, or recognised national equivalent
• Active board certification in psychiatry, such as ABPN, FRCPC, MRCPsych, FRANZCP , or recognised national equivalent
• Active and unrestricted medical licence
• At least 3 years of independent psychiatric practice after residency, currently or within the last two years
• Professional practice within an accredited or government-licensed hospital, academic centre, community clinic, private practice, or telehealth setting
• Based in the United States, United Kingdom, Europe, or Australia, with US-based candidates particularly welcome
• Strong expertise in psychiatric diagnosis, differential diagnosis, risk assessment, and clinical reasoning

Nice To Haves

• Current direct patient-care experience is highly valued
• Fellowship, subspecialty certification, or 2+ years of focused practice in a psychiatry subspecialty is advantageous
• Experience developing or examining OSCEs is advantageous
• Current or recent faculty appointment within a psychiatry department is advantageous
• Strong written communication and ability to explain complex clinical reasoning precisely

Responsibilities

• Advanced Psychiatric Case Design: Develop challenging psychiatric cases that test advanced diagnostic and clinical reasoning. Create scenarios involving nuanced differentials, atypical presentations, and competing diagnoses. Incorporate realistic clinical uncertainty and incomplete information where appropriate. Design cases that expose weaknesses in current AI reasoning. Ensure tasks reflect real-world psychiatric practice and professional standards.
• Diagnostic & Clinical Reasoning: Evaluate psychiatric presentations using structured clinical reasoning. Develop gold-standard diagnostic interpretations and differential diagnoses. Explain how relevant symptoms, history, examination findings, and contextual factors affect clinical conclusions. Identify misleading or insufficient reasoning in AI-generated responses. Apply expert judgement to cases where multiple plausible interpretations must be distinguished.
• Risk Assessment & Clinical Decision-Making: Develop and review scenarios involving psychiatric risk assessment. Evaluate reasoning around safety, urgency, escalation, and appropriate next steps. Incorporate nuanced considerations relevant to complex psychiatric presentations. Assess whether AI systems appropriately recognise high-risk findings. Identify common errors in model reasoning around clinical risk and prioritisation.
• Gold-Standard Answer Development: Produce authoritative reference answers with clear clinical reasoning. Explain the basis for diagnostic and management conclusions. Highlight critical distinctions that separate strong from weak clinical responses. Develop responses suitable for benchmarking advanced AI systems. Maintain high standards of clinical accuracy, clarity, and completeness.
• AI Model Evaluation: Review AI-generated responses to advanced psychiatric cases. Identify recurring reasoning errors, omissions, and unsafe assumptions. Compare model behaviour against expert clinical standards. Provide structured feedback to research teams. Help improve evaluation criteria for psychiatric reasoning tasks.
• Subspecialty Expertise: Apply specialist knowledge where relevant across areas such as: Addiction Psychiatry, Child & Adolescent Psychiatry, Forensic Psychiatry, Geriatric Psychiatry, Consultation-Liaison Psychiatry. Contribute subspecialty cases reflecting realistic clinical complexity. Apply fellowship, board, or substantial practice-based expertise to specialised scenarios.

Benefits

• Part-time independent contractor engagement
• Fully remote
• Flexible scheduling based on project requirements
• Compensation: Up to $140/hour
• Initial screening includes a 20–30 minute interview covering clinical background and subspecialty expertise
• Contributors may collaborate directly with AI research teams
• Projects may be extended, shortened, or concluded based on project needs and performance
• Work must be completed without using confidential or proprietary information belonging to any employer, patient, client, institution, or other third party
• H1-B and STEM OPT support is unavailable for this engagement

What This Job Offers

• Job Type: Part-time
• Career Level: Senior