Physician Reviewer (MD/DO) - Medical AI Evaluation

Mindrift • Reading, PA

1d • Remote

About The Position

Mindrift is recruiting actively practicing MDs or DOs with an active, unrestricted U.S. medical license for a project-based medical AI evaluation opportunity. Reviewers evaluate written clinical EHR vignettes for diagnosis and treatment tasks, primarily in general and internal medicine. The work covers cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems. There is no patient contact and no malpractice exposure. Contributions are project-based and intended to fit around clinical practice; contributors choose when and how much to work while the project is active. Tasks are estimated at about 10–20 hours per week during active phases, but this is not a minimum or guaranteed workload. Tasks must be submitted within project timelines and meet acceptance criteria. Work follows three independent blind reads and physician adjudication. Compensation is per approved task at a flat rate estimated to equal about $100 per hour based on task estimates; QA and adjudication tasks are paid at a higher rate. A one-time $50 onboarding reward is paid after the first production task is approved, and additional incentives may be available for high-quality approved tasks under the project guidelines.

Requirements

• Medical degree (MD or DO).
• Active, unrestricted U.S. medical license, verified at onboarding and re-checked monthly.
• Board certification or completed residency training, with recent direct patient care; attending-level experience is preferred.
• Broad, multi-system diagnostic and treatment experience in internal, family, emergency, or hospital medicine.
• Strong clinical reasoning, including differential diagnosis, next-step management, and application of evidence-based guidelines.
• Strong written English at C1+ level.
• Must be a practicing physician; the opportunity is not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or non-clinical healthcare titles.

Nice To Haves

• Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/quality assurance.
• Attending-level experience.

Responsibilities

• Evaluate clinical EHR vignettes paired with questions, proposed answers, and distractor answers across diagnosis and treatment tasks.
• Assess benchmark items for vignette accuracy and completeness, whether the vignette gives away the answer, answer correctness and gradeability, and the quality of trap answers.
• Determine whether the reasoning chain reaches the answer using only facts from the vignette, check reasoning traces, and write short rationales.
• Participate in a process involving three independent blind reads followed by physician adjudication.
• Submit tasks within project timelines and meet the stated acceptance criteria.

Benefits

• Flexible contribution schedule and ability to work from anywhere.
• No patient contact and no malpractice exposure.
• Flat-rate compensation per approved task, estimated at about $100 per hour based on task time.
• Higher rates for QA and adjudication tasks.
• One-time $50 onboarding reward after the first production task is approved.
• Additional incentives for high-quality approved tasks.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: Ph.D. or professional degree