Internal Medicine Physician - Remote Clinical Case Review

Mindrift • Houston, TX

6d • Remote

About The Position

Mindrift connects specialists with project-based AI opportunities for leading technology companies focused on testing, evaluating, and improving AI systems. This opportunity is for US-based, actively practicing physicians (MD or DO) to evaluate clinical EHR vignettes for a medical AI evaluation program, with a primary focus on general and internal medicine. Work is project-based and participation is non-permanent. During active project phases, tasks are estimated to require approximately 10–20 hours per week; this is not guaranteed workload. Tasks must be submitted by the deadline and meet acceptance criteria. Compensation is paid per accepted task, with rates depending on qualification tier and efficiency, up to the equivalent of $70 per hour.

Contributors evaluate clinical vignettes and related questions, proposed answers, and distractor “trap” answers across multiple body systems. They assess the quality of benchmark items and clinical reasoning, check whether conclusions follow from the vignette facts, provide short rationales, and participate in a process involving three independent blind reads followed by physician adjudication.

Requirements

• Medical degree (MD or DO).
• Active, unrestricted US medical license, verified with the issuing medical board.
• Board certification or completed residency training, with recent direct patient care; attending-level experience is preferred.
• Broad, multi-system diagnostic and treatment experience in internal, family, emergency, or hospital medicine.
• Strong clinical reasoning, including differential diagnosis, next-step management, and application of evidence-based guidelines.
• Strong written English proficiency (C1+).

Nice To Haves

• Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/quality assurance.
• Attending-level experience.

Responsibilities

• Evaluate clinical EHR vignettes paired with questions, proposed answers, and distractor “trap” answers across diagnosis and treatment tasks.
• Score benchmark items for vignette accuracy and completeness, whether the vignette gives away the answer, answer correctness and gradeability, and trap quality.
• Assess whether the reasoning chain reaches the answer using only the facts in the vignette, review reasoning traces, and write short rationales.
• Participate in three independent blind reads followed by physician adjudication.
• Submit tasks by deadlines and meet the stated acceptance criteria.

What This Job Offers

• Job Type: Part-time
• Career Level: Senior
• Education Level: Ph.D. or professional degree