Applied Health & Medicine Benchmark Specialist
About The Position
This role is for one of our clients. We are seeking highly qualified medical and health science professionals to contribute to an AI research initiative focused on developing rigorous academic assessment content across health and medicine. As an Applied Health & Medicine Benchmark Specialist, you will author and review challenging multiple-choice questions, evaluate the quality and validity of existing assessment content, and help establish high-quality benchmarks for measuring AI performance on advanced medical and health science concepts. You may be assigned one of two primary task types: Question Authoring: Develop original, challenging multiple-choice questions within your area of expertise, assess their difficulty, provide a detailed solution, and submit them for review. Question Verification: Review existing questions for medical accuracy, clarity, completeness, and rigor; make necessary edits; assess difficulty; and document the rationale for changes. Work may span one or more of the following areas: Clinical Medicine & Surgery, Medical Imaging & Diagnostics, Pharmacovigilance, Healthcare Management & Economics, Rehabilitation & Allied Health, Biomedical and Health Sciences.
Requirements
- MD, DO, PhD, or doctoral candidate in Medicine, Biomedical Sciences, Public Health, or a closely related discipline.
- A Master's degree may be considered for candidates with exceptional expertise in a specialized health or medical domain.
- Strong command of advanced medical knowledge, biomedical science, clinical reasoning, and research methodology.
- Ability to critically evaluate medical evidence and distinguish nuanced, technically correct answers from plausible but incorrect alternatives.
- Excellent written English with the ability to communicate complex medical and scientific concepts clearly and precisely.
- Strong attention to detail and a rigorous approach to fact-checking and quality assurance.
- Comfortable working independently on challenging, open-ended academic assessment tasks.
Nice To Haves
- Board certification, relevant clinical experience, research publications, or advanced specialization in a health-related field is highly desirable.
Responsibilities
- Develop original assessment questions that test deep conceptual understanding, clinical reasoning, and applied knowledge, rather than simple factual recall.
- Ensure every question is self-contained, unambiguous, technically accurate, and sufficiently defined to support a clear solution.
- Assign an appropriate difficulty level: Medium: Introductory undergraduate, Hard: Advanced undergraduate, Expert: Postgraduate level and above.
- Create one correct answer alongside nine plausible but subtly incorrect alternatives designed to meaningfully challenge advanced AI systems.
- Develop clear, structured solutions that explain the reasoning required to reach the correct answer.
- Support questions with 1–5 reputable academic references, such as peer-reviewed research, clinical guidelines, authoritative textbooks, or recognized medical sources.
- For verification assignments, identify issues related to: Medical or scientific accuracy, Clarity, Completeness, Precision, Solvability, Answer validity.
- Make appropriate corrections and clearly document the reasoning behind significant edits.
- Maintain a high standard of academic and professional rigor across all assessment content.
Benefits
- Weekly payments based on services rendered through available payment platforms.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Part-time
Career Level
Mid Level
