Radiology Specialist (Contract)

mpathic

38d

About The Position

We're seeking experienced radiologists to help evaluate the next generation of multimodal AI systems by assessing how they interpret medical images, radiology reports, and complex clinical instructions. This benchmark dataset project focuses on evaluating AI models for visual document understanding and instruction-following in the radiology domain. You'll develop challenging, clinically realistic evaluation tasks, create expert reference answers, and identify where today's AI systems succeed—and where they fall short.

Requirements

MD, DO, or internationally equivalent medical degree.
Completion of an accredited Diagnostic Radiology residency (ACGME, AOA, or recognized international equivalent).
Current board certification in Diagnostic Radiology (ABR, FRCPC, FRANZCR, or recognized national equivalent).
Current, active, unrestricted medical license with no suspension, revocation, or ongoing disciplinary action.
At least 3 years of independent clinical practice following residency (training years excluded), currently practicing or having practiced within the past two years.
Experience practicing in an accredited or government-licensed healthcare setting, including hospitals, academic medical centers, outpatient imaging centers, or private practice.

Nice To Haves

Currently providing at least 10 hours of direct clinical interpretation per week.
Fellowship training or significant clinical expertise in a radiology subspecialty, including: Neuroradiology, Musculoskeletal Radiology, Body Imaging, Breast Imaging, Cardiothoracic Radiology, Pediatric Radiology, Interventional Radiology, Emergency Radiology.
Experience interpreting multimodal imaging studies, including CT, MRI, ultrasound, mammography, nuclear medicine, and plain radiography.
Experience reviewing AI-assisted imaging tools or participating in imaging AI research is a plus.
Passion for advancing trustworthy AI in healthcare.

Responsibilities

Design clinically realistic evaluation tasks using radiology images, reports, and supporting clinical documentation.
Create expert-level prompts that assess visual document understanding, diagnostic reasoning, and instruction-following across radiology workflows.
Evaluate AI-generated responses using structured rubrics for diagnostic accuracy, completeness, safety, and adherence to instructions.
Identify challenging edge cases, subtle imaging findings, and common model failure modes across multiple imaging modalities.
Provide detailed written feedback that helps improve model performance and benchmark quality.
Collaborate directly with research teams at a leading AI lab to advance multimodal healthcare AI.
Participate in onboarding, calibration sessions, and ongoing quality reviews.