Licensed Physician (MD/DO) - Freelance AI Trainer

Mindrift•Flint, MI

5d•Remote

About The Position

Mindrift is seeking actively practicing physicians with an active, unrestricted U.S. medical license to evaluate clinical EHR vignettes for a medical AI evaluation project, with a primary focus on general and internal medicine. Contributors review written clinical cases and do not have patient contact or malpractice exposure. All reviewers are license-verified physicians. Tasks involve assessing clinical vignettes and related questions, proposed answers, and distractor answers across multiple body systems. Contributors evaluate clinical reasoning and benchmark-item quality, check whether conclusions follow from vignette facts, review reasoning traces, and write short rationales. Work includes three independent blind reads followed by physician adjudication. The opportunity is project-based and designed to fit around clinical practice. Contributors choose when and how much to work; tasks are estimated at approximately 10–20 hours per week during active project phases, but this is neither a minimum nor a guaranteed workload. Tasks must be submitted within the project timeline and meet acceptance criteria. Compensation is per approved task at a flat rate estimated to be equivalent to about $100 per hour based on task time. QA and adjudication tasks are paid at a higher rate, and incentives may provide additional earnings for high-quality approved tasks. A one-time $50 onboarding reward is paid after the first production task is approved.

Requirements

Medical degree (MD or DO).
Active, unrestricted U.S. medical license, verified at onboarding and re-checked monthly.
Board certification or completed residency training.
Recent direct patient care experience; attending-level experience is preferred.
Broad, multi-system diagnostic and treatment experience, such as in internal, family, emergency, or hospital medicine.
Strong clinical reasoning, including differential diagnosis, next-step management, and application of evidence-based guidelines.
Strong written English (C1+).

Nice To Haves

Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/quality assurance.
Attending-level clinical experience.

Responsibilities

Evaluate clinical EHR vignettes paired with questions, proposed answers, and distractor answers across diagnosis and treatment tasks.
Assess benchmark items for vignette accuracy and completeness, whether the vignette gives away the answer, answer correctness and gradeability, and distractor quality.
Check whether reasoning chains reach conclusions using only the facts in the vignette and review the correctness of reasoning traces.
Write short rationales for evaluations.
Participate in three independent blind reads followed by physician adjudication.
Submit tasks within project timelines and meet the stated acceptance criteria.