Principal Psychometrician

Pearson

About The Position

The Principal Psychometrician is responsible for leading psychometric strategy and solution design for large-scale assessment programs, with a primary focus on supporting state procurements and advancing innovative, defensible measurement approaches. This role includes designing psychometric frameworks aligned to federal peer review requirements, advising on operational and research models, and collaborating across teams to ensure technically sound and scalable assessment solutions. The role requires deep expertise in IRT and large-scale operational psychometrics, strong knowledge of the assessment landscape, and the ability to translate complex technical concepts into practical, client-centered solutions. This individual must be both technically rigorous and strategically minded, with the ability to anticipate state needs and design creative, defensible approaches to meet them.

Requirements

8+ years of experience in large-scale educational assessment, including operational psychometrics
Advanced degree (PhD preferred) in Psychometrics, Statistics, Measurement, or a related field
Deep expertise in Item Response Theory (IRT) and its application in large-scale assessments
Experience designing and implementing psychometric models for statewide or large-scale assessment programs
Strong understanding of federal assessment requirements, including peer review expectations
Experience supporting or leading technical components of state RFP responses or procurements
Demonstrated experience with calibration, equating, scaling, and standard setting methodologies
Strong analytical and problem-solving skills, with the ability to apply theory to operational contexts
Experience developing technical documentation and communicating results to diverse audiences

Nice To Haves

Strategic mindset with the ability to anticipate client needs and design forward-looking solutions
Strong collaboration skills and ability to work across content, product, and operational teams
Ability to balance technical rigor with practical implementation constraints
Excellent written and verbal communication skills, including the ability to explain complex concepts clearly
High level of organization and ability to manage multiple priorities in a fast-paced environment
Curiosity and commitment to staying current with advancements in psychometrics and assessment design

Responsibilities

Lead psychometric solution design for state procurements, including technical approaches for scaling, equating, reporting, and standard setting
Develop and articulate defensible psychometric methodologies aligned to federal assessment peer review requirements
Design and evaluate IRT-based models, including calibration, equating, scaling, and linking approaches across assessment programs
Advise on operational psychometric processes, including field testing, item calibration, form assembly, and quality control procedures
Lead strategic engagement with Technical Advisory Committees (TACs) and expert groups to inform, validate, and advance innovative assessment solutions, while guiding clients toward aligned, defensible approaches
Partner with content, product, psychometric, implementation, and operational teams to ensure psychometric considerations are integrated across the assessment lifecycle
Support development of technical documentation for proposals, including technical reports, validity evidence, and methodological justifications
Lead cross-functional solution design across School Assessment, partnering with measurement and learning, new ventures, partner success, technology, and product teams to develop innovative, scalable solutions and ensure effective transition from design to execution
Identify innovative and practical approaches to meet evolving state and federal assessment needs
Conduct or guide research studies to support validity, reliability, fairness, and comparability of assessment systems
Translate complex psychometric concepts into clear, actionable guidance for internal teams and external stakeholders
Provide technical leadership and mentorship to psychometric and cross-functional teams