Senior Physician / Surgeon Expert (AI Clinical Evaluation)

Gramian Consulting Group

1d•Remote

About The Position

Gramian Consultancy is seeking experienced physicians and surgeons to assist in the training and evaluation of sophisticated AI systems. This role involves the creation and review of intricate clinical scenarios designed to assess AI performance in areas such as diagnostic reasoning, differential diagnosis, treatment planning, guideline interpretation, and clinical risk management. The ideal candidate is a senior clinician with significant post-residency experience, up-to-date knowledge of modern standards of care, and the ability to transform complex medical judgment into structured, technically precise evaluation tasks.

Requirements

MD, DO, or equivalent medical qualification with recent board certification.
8-15 years of post-residency clinical practice.
Active clinical practice within the last 3 years.
Expertise in complex diagnostic reasoning and treatment planning.
Proven track record of high-level medical deliverables.
Exceptional analytical thinking and attention to detail.
Superior written communication skills.
Ability to work independently in a fast-paced environment.

Responsibilities

Create high-difficulty clinical tasks based on realistic physician and surgical scenarios.
Develop gold-standard solutions covering diagnosis, workup, treatment planning, and clinical decision-making.
Build cases involving complex histories, laboratory results, imaging, symptoms, and competing diagnostic hypotheses.
Evaluate AI-generated clinical outputs for accuracy, completeness, safety, and adherence to current standards.
Create scenarios involving differential diagnosis, treatment pathways, procedural decisions, and risk management.
Apply established evaluation rubrics and grading standards consistently.
Review and refine patient charts, clinical management plans, consultation notes, and treatment recommendations.
Incorporate calibration feedback and revise task designs as required.
Maintain strong alignment with current medical guidelines and patient-safety principles.
Escalate genuine clinical edge cases or ambiguous evaluation criteria to the functional expert lead.