Healthcare Expert (MD, DO, RN, NP, PA, MPH)

Weekday AI

55d • $150 - $190 • Remote

About The Position

We partner with leading AI research teams to enhance the quality, reliability, and real-world usefulness of general-purpose conversational AI systems. These systems are increasingly used in healthcare-related contexts, where accuracy, clarity, and responsible reasoning are critical.
This project focuses on evaluating and improving how conversational AI systems respond to medical and healthcare topics. Your clinical expertise will help ensure that responses are factually accurate, clearly explained, clinically sound, and aligned with real-world healthcare standards.
Role Overview
As a Healthcare Expert, you will apply your professional experience to evaluate and refine AI-generated responses related to medicine, patient care, and healthcare systems. You will help identify inaccuracies, strengthen clinical reasoning, and ensure safe and appropriate communication for diverse healthcare scenarios.

Requirements

• Minimum of 5 years of professional experience in healthcare.
• Relevant advanced degree or professional credential (e.g., MD, DO, RN, NP, PA, PharmD, MPH, or equivalent).
• Experience in one or more of the following areas: General Clinical Care, Specialty Medicine or Surgery, Diagnostics, Imaging, or Laboratory Medicine, Public Health, Healthcare Systems, or Administration
• Strong familiarity with large language models (LLMs) and practical understanding of how they are used in healthcare and professional contexts.
• Excellent written communication skills for complex medical and clinical topics.
• Exceptional attention to detail, with the ability to detect subtle inaccuracies or gaps in clinical reasoning.

Nice To Haves

• Prior experience with reinforcement learning from human feedback (RLHF), model evaluation, or data annotation.
• Experience writing or editing high-quality medical or healthcare content.
• Background in clinical documentation, charting, or patient communication.
• Familiarity with structured evaluation rubrics, benchmarks, or quality scoring systems.

Responsibilities

• Write and refine prompts to guide AI behavior in healthcare-related scenarios.
• Evaluate large language model (LLM) responses for medical accuracy, reasoning quality, clarity, and completeness.
• Fact-check medical and healthcare claims using trusted public and authoritative sources.
• Annotate responses by identifying strengths, weaknesses, factual inaccuracies, and conceptual gaps.
• Assess tone, safety, and appropriateness for real-world healthcare communication, including patient-facing contexts.
• Ensure responses align with expected conversational standards and project guidelines.
• Apply consistent evaluation frameworks, taxonomies, and benchmarking standards.

What This Job Offers

• Education Level: No Education Listed