Psychometrician

NIGHTINGALE EDUCATION LLC SOLE MB•Salt Lake City, UT

1d•Onsite

About The Position

The Psychometrician serves as Nightingale College’s lead expert in measurement science and competency evaluation within its online nursing education environment. Sitting within the Data & Technology department, this role partners closely with nursing faculty and curriculum designers to ensure every assessment produces reliable, valid, and defensible evidence of learner competency — translating measurement science into clinical readiness signals that are statistically sound and regulator-ready.

Requirements

Master’s degree or higher in Psychometrics, Educational Measurement, Statistics, or a closely related quantitative field is required
Minimum of two – four years of experience in assessment, educational testing, research, or a closely related field is required
Demonstrated experience conducting validity and reliability analyses is required
Proficiency in statistical tools such as R, Python, SAS, or equivalent, and data visualization platforms (Power BI or Tableau) is required
Experience retrieving and manipulating data using SQL or similar database querying methods is required

Nice To Haves

Doctoral degree (PhD) in Psychometrics, Educational Psychology, or a related quantitative field is preferred
Experience in health professions or nursing education environments is preferred
Familiarity with NCLEX-style testing and the Clinical Judgment Measurement Model (CJMM) is preferred
Experience in competency-based, simulation-based, or online education settings is preferred

Responsibilities

Design and validate scenario-based assessments and clinical judgment evaluations aligned to concept-based curriculum and NCLEX standards.
Establish cut scores and performance standards using evidence-based methodologies including IRT, CTT, and Generalizability Theory.
Operationalize the Clinical Judgment Measurement Model (CJMM) into scoreable item types that assess cue recognition, prioritization, and decision-making.
Monitor reliability indices and gather validity evidence across content, construct, and criterion-related dimensions for all active assessments.
Conduct item analysis, DIF reviews, and standard-setting studies (Angoff, Bookmark) to ensure defensible cut scores and bias-free measurement.
Produce psychometric evidence packages that support accreditation reviews, progression decisions, and NCSBN/CCNE compliance.
Analyze assessment data to surface learner performance trends, identify concept mastery gaps, and predict NCLEX readiness.
Build dashboards and reports in Power BI or Tableau to support curriculum decisions, faculty calibration, and student progression.
Retrieve and manipulate institutional data using SQL, R, Python, or SAS; integrate psychometric outputs into the broader Analytics team infrastructure.
Design measurement frameworks for virtual simulation, skills-based demonstrations, and rubric-based clinical evaluations.
Develop inter-rater reliability protocols and calibration processes to ensure consistent scoring across simulation modalities.
Establish psychometric standards for rubric design, holistic scoring, and performance level descriptors at scale.
Educate faculty and academic leaders on assessment validity, reliability, and psychometric data interpretation.
Lead calibration sessions and translate measurement science into practical guidance for item writing, rubric design, and student feedback.
Contribute to program development, curriculum review, and professional conferences relevant to educational measurement and nursing education.
Performs other duties as assigned.