General Physician (AI Evaluation)

Gramian Consulting Group

1d • Remote

About The Position

Gramian Consultancy is seeking licensed physicians currently practicing in the United States to support the evaluation and improvement of advanced AI systems in healthcare. The contractor assignment lasts 12 weeks and may be part-time or full-time, with a commitment of 20–40 hours per week. The position is remote within the USA.

The physician will review AI-generated clinical content—including diagnoses, treatment plans, summaries, and other case-based outputs—for medical accuracy, safety, completeness, and relevance. Using real-world clinical judgment and evidence-based standards, the physician will identify errors, unsafe recommendations, missing information, and weak reasoning, then provide structured feedback to improve the quality and reliability of medical AI systems.

Candidates must be fully licensed and actively practicing medicine in the United States. Selection is based on an online questionnaire and review of the candidate’s resume, education, and certifications.

Requirements

• Medical Doctor (MD) or equivalent medical qualification, such as MBBS, MBChB, or equivalent.
• Fully licensed to practice medicine in the United States.
• Currently actively practicing medicine in the United States.
• At least 1 year of post-residency clinical practice experience as a physician.
• Strong general clinical judgment; no specific specialty is required.

Responsibilities

• Review AI-generated medical content for accuracy, safety, and completeness.
• Evaluate diagnoses, treatment plans, case summaries, and clinical reasoning.
• Identify inaccurate, unsafe, misleading, or incomplete medical outputs.
• Apply evidence-based medical standards and professional clinical judgment.
• Provide structured expert feedback to improve model quality.
• Follow detailed evaluation and annotation guidelines.
• Complete structured questionnaires and reviews using web-based tools.
• Collaborate with clinical and AI teams on quality improvement.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: Ph.D. or professional degree