Physician (MD/DO) - Medical AI Evaluation

Mindrift • Lake Charles, LA

1d • Remote

About The Position

Mindrift is seeking actively practicing physicians with an active, unrestricted U.S. medical license to evaluate clinical EHR vignettes for a medical AI evaluation project. The main focus is general and internal medicine. Contributors review written clinical cases; there is no patient contact or malpractice exposure. The opportunity is project-based and designed to fit around clinical practice, with contributors choosing when and how much to work. Tasks are estimated at approximately 10–20 hours per week during active project phases, but this is not a minimum or guaranteed workload. Tasks must be submitted within the project timeline and meet the stated acceptance criteria.

Physicians evaluate vignettes paired with questions, proposed answers, and distractor “trap” answers across diagnosis and treatment tasks. They assess vignette accuracy and completeness, whether a vignette gives away the answer, answer correctness and gradeability, and trap quality. They also assess whether reasoning reaches the answer using only the vignette facts, check reasoning traces, and write short rationales. The workflow includes three independent blind reads followed by physician adjudication.

Compensation is a flat rate per approved task, set at approximately $100 per hour equivalent based on estimated task time. QA and adjudication tasks are paid at a higher rate, and incentives may provide additional earnings for high-quality approved tasks. A one-time $50 onboarding reward is paid after the first production task is approved. The application process is: apply, pass qualification(s), join a project, complete tasks, and get paid.

Requirements

• Medical degree (MD or DO).
• Active, unrestricted U.S. medical license, verified at onboarding and re-checked monthly.
• Board certification or completed residency training; recent direct patient care experience, with attending-level experience preferred.
• Broad, multi-system diagnostic and treatment experience, such as internal, family, emergency, or hospital medicine.
• Strong clinical reasoning, including differential diagnosis, next-step management, and application of evidence-based guidelines.
• Strong written English (C1+).

Nice To Haves

• Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/quality assurance.
• Attending-level experience is preferred.

Responsibilities

• Evaluate clinical EHR vignettes paired with questions, proposed answers, and distractor trap answers across diagnosis and treatment tasks.
• Assess vignette accuracy and completeness, whether the vignette gives away the answer, answer correctness and gradeability, and trap quality.
• Check whether the reasoning chain reaches the answer using vignette facts alone, review reasoning traces, and write short rationales.
• Participate in a workflow of three independent blind reads followed by physician adjudication.
• Submit tasks within project timelines and meet the listed acceptance criteria.

Benefits

• $50 one-time onboarding reward after the first production task is approved.
• Additional earnings for high-quality approved tasks; terms are provided in the project guidelines.
• Flexible contribution schedule: contributors choose when and how much to work.
• Work from anywhere.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: Ph.D. or professional degree