Licensed Physician (MD/DO) - Freelance AI Trainer

Mindrift•Lebanon, PA

5d•Remote

About The Position

Mindrift is seeking actively practicing physicians with an MD or DO and an active, unrestricted US medical license who live outside the United States. The project focuses mainly on general and internal medicine and involves evaluating clinical EHR vignettes for a medical AI evaluation project. Contributors review written cases only; there is no patient contact or malpractice exposure. Participation is project-based and designed to fit around clinical practice, with flexible scheduling and an estimated 10–20 hours per week during active project phases. This estimate is not a minimum or a guaranteed workload. Contributors assess clinical reasoning benchmark items, including vignette accuracy and completeness, whether a vignette reveals its answer, answer correctness and gradeability, and the quality of distractor “trap” answers. They check whether reasoning follows from the vignette facts, evaluate reasoning traces, and write short rationales. Work proceeds through three independent blind reads followed by physician adjudication. Payment is per approved task at a flat rate equivalent to about $35 per estimated hour; QA and adjudication tasks are paid at a higher rate. A one-time $50 onboarding reward is paid after the first production task is approved, and additional incentives may be offered for high-quality approved tasks under project guidelines. Applicants submit an English CV and indicate their English proficiency.

Requirements

Medical degree (MD or DO).
Active, unrestricted US medical license; verified at onboarding and re-checked monthly.
Actively practicing physician living outside the United States.
Board certification or completed residency training; recent direct patient care.
Broad, multi-system diagnostic and treatment experience, such as internal, family, emergency, or hospital medicine.
Strong clinical reasoning, including differential diagnosis, next-step management, and application of evidence-based guidelines.
Strong written English at C1 level or higher.

Nice To Haves

Attending-level experience is preferred.
Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/quality assurance.

Responsibilities

Evaluate clinical EHR vignettes paired with questions, proposed answers, and distractor “trap” answers across diagnosis and treatment tasks and multiple body systems.
Score benchmark items for vignette accuracy and completeness, answer leakage, answer correctness and gradeability, and trap quality.
Assess whether the reasoning chain reaches the answer using only the vignette facts; review reasoning traces and write short rationales.
Participate in three independent blind reads followed by physician adjudication.
Submit tasks within project timelines and meet the stated acceptance criteria.