Clinical Medicine Domain Expert

Weekday AI•California City, CA

4d•$70 - $110•Hybrid

About The Position

This role is for one of our clients. We are seeking an experienced Clinical Medicine Domain Expert to contribute to a cutting-edge GenAI initiative focused on improving how advanced AI models understand, reason about, and respond to real-world clinical scenarios. Your clinical expertise will be central to this role. You will evaluate medical knowledge tasks and AI-generated outputs, develop detailed instructions and reference solutions, and create rigorous benchmarks that establish what high-quality clinical reasoning looks like. We are looking for an experienced practicing clinician with deep expertise in a defined medical specialty. This is a full-time position requiring 40 hours per week for an initial six-month engagement. The role involves working closely with research and program teams and using standard enterprise tools and workflows. This is a hybrid role based in the Bay Area, California. Candidates must be based in the Bay Area and able to work on-site with the team multiple days per week when required. This is not a fully remote position. Candidates currently outside the Bay Area must be willing to relocate at their own expense before the engagement begins. Relocation assistance is not provided.

Requirements

MD or DO from an accredited medical school, along with completion of residency training in a recognized medical specialty.
Minimum 4 years of post-residency clinical practice. Residency and fellowship training alone do not count toward this requirement.
Active and unrestricted medical license in at least one U.S. state.
Board certification in the candidate's primary medical specialty.
Deep expertise in a defined clinical specialty, such as: Internal Medicine, Oncology, Radiology, Emergency Medicine, Surgery, Psychiatry, Medical subspecialties.
Demonstrated progression into a senior clinical role such as Attending Physician, Medical Director, Division Chief, Associate Professor, Full Professor, or Chief Medical Officer.
Proven ownership of meaningful clinical decisions, patient-care processes, clinical programs, or medical initiatives.
Practical experience using large language models or AI tools in a professional setting, with the ability to distinguish clinically sound reasoning from plausible but incorrect or unsafe outputs.
Ability to commit reliably to 40 hours per week for an initial six-month engagement.
Must reside in or be willing to relocate to the Bay Area, California, and work on-site multiple days per week when required. Relocation expenses are not covered.
Excellent written communication skills with the ability to provide precise, structured, and actionable clinical feedback.

Nice To Haves

Experience in utilization management, clinical informatics, medical affairs, or related areas is a plus.
Experience contributing to clinical research, medical education, healthcare technology, or evidence-based clinical initiatives.
Familiarity with clinical guidelines, medical literature, evidence-based medicine, and healthcare decision-making frameworks.
Experience evaluating medical content, clinical documentation, or healthcare-related AI systems.
Background working across multidisciplinary clinical and technical teams.
Strong interest in the application of AI to healthcare and clinical decision support.

Responsibilities

Review and assess clinical knowledge tasks and AI-generated medical outputs for accuracy, safety, completeness, and clinical relevance.
Identify missing reasoning steps, unsupported conclusions, unsafe recommendations, deviations from established guidelines, and clinically inappropriate responses.
Evaluate whether AI-generated answers meet the standards expected in real-world clinical practice.
Develop clear, detailed instruction specifications that define expected clinical reasoning and outcomes.
Create high-quality reference solutions for complex clinical problems and scenarios.
Develop new clinical tasks that accurately represent how healthcare professionals evaluate and solve real-world medical problems.
Design challenging clinical scenarios and evaluation datasets that test medical reasoning, decision-making, and domain knowledge.
Contribute to the development of medicine-specific benchmarks, tools, and evaluation methodologies.
Help establish measurable standards for assessing the quality and reliability of AI-generated clinical responses.
Collaborate with researchers and specialists from adjacent medical and technical disciplines to maintain consistent evaluation standards.
Translate practical clinical judgment and experience into explicit, structured, and teachable evaluation criteria.
Provide precise written feedback that helps improve the quality and reliability of AI systems.
Help translate real-world clinical expertise into structured evaluation frameworks, high-quality clinical tasks, reference solutions, and benchmarks for next-generation AI systems.
Ensure that AI models produce responses that are not only convincing and well-written, but also clinically accurate, evidence-based, safe, and aligned with professional standards of care.