Board-Certified Physician - Non-Clinical Remote Case Review

Mindrift • Macon, GA

8d • $100 • Remote

About The Position

Mindrift connects specialists with project-based AI opportunities for leading technology companies focused on testing, evaluating, and improving AI systems. This opportunity is for US-based, actively practicing physicians to evaluate clinical EHR vignettes for a medical AI evaluation program, with a primary focus on general and internal medicine. Participation is project-based and non-permanent.

Contributors evaluate clinical vignettes and benchmark items across multiple body systems, assess clinical reasoning and answer quality, verify reasoning traces, and provide short rationales. Work involves three independent blind reads followed by physician adjudication. Tasks are estimated to take around 10–20 hours per week during active project phases; this is not a guaranteed workload. Tasks must be submitted by deadlines and meet acceptance criteria. Compensation is per accepted task, with rates depending on qualification tier and task efficiency, up to the equivalent of $100 per hour.

Requirements

• Be a US-based, actively practicing physician with an MD or DO degree.
• Hold an active, unrestricted US medical license, verified with the issuing medical board.
• Have board certification or completed residency training, with recent direct patient care; attending-level experience is preferred.
• Have broad, multi-system diagnostic and treatment experience in internal, family, emergency, or hospital medicine.
• Demonstrate strong clinical reasoning, including differential diagnosis, next-step management, and application of evidence-based guidelines.
• Have strong written English proficiency (C1+).
• Be willing to take on part-time, non-permanent project work.

Nice To Haves

• Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA.
• Attending-level clinical experience.

Responsibilities

• Evaluate clinical EHR vignettes paired with questions, proposed answers, and distractor trap answers across diagnosis and treatment tasks and multiple body systems.
• Score benchmark items for vignette accuracy and completeness, whether the vignette reveals the answer, answer correctness and gradeability, and trap quality.
• Assess whether the reasoning chain reaches the answer using only facts in the vignette, check reasoning traces, and write short rationales.
• Participate in three independent blind reads followed by physician adjudication.
• Submit tasks by the deadline and meet the listed acceptance criteria.

What This Job Offers

• Job Type: Part-time
• Career Level: Senior
• Education Level: Ph.D. or professional degree