General Physician (AI Evaluation)

Gramian Consulting Group

2d • Remote

About The Position

Gramian Consultancy is seeking licensed physicians currently practicing in the United States to evaluate and enhance advanced AI systems in healthcare. This role requires reviewing AI-generated clinical content, such as diagnoses, treatment plans, and summaries, for medical accuracy, safety, completeness, and relevance. You will utilize your real-world clinical judgment to pinpoint errors, unsafe recommendations, missing information, and flawed reasoning, thereby contributing to the improvement of medical AI systems' quality and reliability.

Requirements

• Medical Doctor (MD) or equivalent medical qualification such as MBBS, MBChB, or equivalent.
• Fully licensed to practice medicine in the United States.
• Currently actively practicing medicine in the US.
• At least 1 year of post-residency clinical practice experience as a physician.
• Strong general clinical judgment; no specific specialty is required.

Responsibilities

• Review AI-generated medical content for accuracy, safety, and completeness.
• Evaluate diagnoses, treatment plans, case summaries, and clinical reasoning.
• Identify inaccurate, unsafe, misleading, or incomplete medical outputs.
• Apply evidence-based medical standards and professional clinical judgment.
• Provide structured expert feedback to improve model quality.
• Follow detailed evaluation and annotation guidelines.
• Complete structured questionnaires and reviews using web-based tools.
• Collaborate with clinical and AI teams on quality improvement.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: Ph.D. or professional degree