This full-time, W-2 role is for an experienced, board-certified physician to work directly with research and program management teams at a leading AI lab. The physician will apply medical expertise and independent clinical judgment to evaluate AI-generated medical content, develop clinical benchmarks, and create reference solutions defining accurate, safe, evidence-based medical reasoning. The position is intended for practicing physicians with substantial post-residency experience and deep expertise in a clinical discipline, who can assess the quality of medical reasoning beyond surface-level correctness. The physician will collaborate with AI researchers, engineers, and specialists from adjacent fields to improve the quality, reliability, and clinical relevance of advanced AI systems. Work includes evaluating clinical knowledge tasks and model responses; developing task specifications, reference answers, benchmarks, and evaluation frameworks; and providing structured feedback to research teams. The position is hybrid in the San Francisco Bay Area, with on-site collaboration multiple days per week as needed. Candidates must live in the area or relocate before the engagement begins; relocation expenses are the candidate’s responsibility, and relocation assistance is not provided. Client-issued accounts and equipment will be provided. The initial engagement is six months, with a commitment of 40 hours per week.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Job Type
Full-time
Career Level
Senior
Education Level
Ph.D. or professional degree