Psychometrician

AICPA•Durham, NC

20d•$80,000 - $95,000•Hybrid

About The Position

You will work with the Psychometrics and Research team to perform large-scale calibrations, scoring, monitoring, program improvement and technical reporting for the Uniform CPA Examination. You will perform programming and data analysis in both operational and research contexts; work across areas within the Examinations Team to provide accurate deliverables; and help implement systems and procedural process improvement. You will report to the Director, Psychometrics & Research and use a hybrid work schedule.

Requirements

Ph.D. in Psychometrics, I/O psychology, Quantitative Psychology, Educational Measurement or a related field
Entry-level candidates and recent graduates with relevant coursework, research, or internship experience will be considered.
Experience with statistical/psychometric programming, machine learning, Natural Language Processing, and/or LLM implementations in test development and psychometrics
0 – 1 years of experience in psychometric analysis within high-stakes testing, certification, or licensure assessment environments

Responsibilities

Prepare item analysis output for item development and program improvement.
Calibrate and maintain item banks using Item Response Theory methods and classical item statistics.
Perform calibration and scoring reviews.
Conduct quality control and data integrity analyses for scoring and reporting; help with producing procedural and quality assurance documentation for external and internal partners.
Support/conduct multiple psychometric analyses, including differential item functioning (DIF), dimensionality, scaling, equating, and speediness analyses.
Help design and implement research studies in response to planned and ad-hoc needs.
Help develop quarterly and annual technical reporting.