Senior Psychometrician & Research Lead

American Board of Emergency Medicine • East Lansing, MI

7d • Remote

About The Position

The Senior Psychometrician and Research Lead provides high-level technical expertise in psychometric analysis and applied research to support ABEM’s high-stakes medical certification examinations. This dual-focus role manages psychometric services across the assessment lifecycle while simultaneously leading research initiatives—including study design, data analysis, and manuscript preparation—to ensure the validity, fairness, and reliability of physician certifications.

Requirements

• Doctoral degree (Ph.D. or Ed.D.) in Psychometrics, Educational Measurement, Quantitative Social Science, or a related field.
• Minimum of 7 years of professional experience encompassing both psychometric practice and applied research.
• Proficiency in R, or SAS software.
• Demonstrated experience with standard setting, equating, and DIF analyses.
• Proven record of peer-reviewed publications and the ability to present complex data to non-technical audiences.

Nice To Haves

• Advanced expertise in assessment design and healthcare research.
• Familiarity with accreditation standards and medical specialty certification.

Responsibilities

• Collaborate with the Principal Psychometrician to guide the design, implementation, and analysis of innovative examination processes.
• Develop and execute computer programs for examination scoring, equating, and item analysis; review and interpret complex results.
• Conduct analytical studies to implement methodologies for improving examinations and measuring the effectiveness of process innovations.
• Review and interpret Differential Item Functioning (DIF) analyses and lead standard-setting activities.
• Provide psychometric support for data exchanges with vendors and other medical boards, maintaining organized and secure data banks.
• Design and execute research studies using ABEM’s physician data, focusing on health equity, clinical performance metrics, and public health.
• Identify and access external datasets (e.g., CMS, ACGME) to complement internal resources.
• Support the preparation and submission of research manuscripts for peer-reviewed journals as a co-author.
• Translate complex psychometric findings into accessible formats for the Board of Directors and internal stakeholders.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: Ph.D. or professional degree
• Number of Employees: 11-50 employees