Licensed Physician (MD/DO) - Freelance AI Trainer

Mindrift • New York, NY

6h • $100

About The Position

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This opportunity is for US-based, actively practicing physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program, with a main focus on general and internal medicine. Projects involve evaluating clinical vignettes and their associated questions, proposed answers, and distractor answers across multiple body systems; assessing benchmark item quality and clinical reasoning; and writing short rationales. The work includes three independent blind reads followed by physician adjudication. Participation is project-based and non-permanent, with an estimated 10–20 hours per week during active project phases. Workload is not guaranteed. Tasks must meet acceptance criteria and be submitted by their deadlines. Contributors are paid per accepted task, with rates determined by qualification tier and efficiency, up to the equivalent of $100 per hour.

Requirements

• Medical degree (MD or DO).
• Active, unrestricted US medical license, verified with the issuing medical board.
• Board certification or completed residency training, with recent direct patient care; attending-level experience is preferred.
• Broad, multi-system diagnostic and treatment experience in internal, family, emergency, or hospital medicine.
• Strong clinical reasoning, including differential diagnosis, next-step management, and application of evidence-based guidelines.
• Strong written English at C1 level or higher.
• US-based and actively practicing as a physician.

Nice To Haves

• Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/quality assurance.
• Attending-level experience.

Responsibilities

• Evaluate clinical EHR vignettes paired with questions, proposed answers, and distractor answers across diagnosis and treatment tasks.
• Assess vignette accuracy and completeness, whether a vignette gives away the answer, answer correctness and gradeability, and the quality of distractor answers.
• Check whether the reasoning chain reaches the answer based only on facts in the vignette; review reasoning traces and write short rationales.
• Participate in three independent blind reads followed by physician adjudication.
• Submit tasks by the deadline and meet the listed acceptance criteria.

What This Job Offers

• Job Type: Part-time
• Career Level: Senior
• Education Level: Ph.D. or professional degree