Principal Psychometrician

FINRA•Jersey City, NJ

40d•$112,300 - $202,500•Hybrid

About The Position

The Principal Psychometrician for Market and Regulatory Services’ Credentialing, Registration, Education & Disclosure (CRED) department provides expert measurement services in support of testing and continuing education programs, ensuring the delivery of valid, reliable assessments that comply with testing industry standards. The role requires conducting psychometric analyses across the full lifecycle of examination program operations, including job/practice analysis, item calibration, standard setting, and data forensics and serving as an internal subject matter expert on psychometric and data analytic methodologies. This position is an experienced individual contributor who works independently with minimal supervision.

Requirements

Master’s Degree in Psychology, industrial/organizational psychology, or Education, with an emphasis on psychometrics, measurement and assessment, or a related field (e.g., statistics, mathematics, or computer science).
Minimum of three (3) years testing industry experience or equivalent combination of education and experience.
Broad knowledge of industry-accepted measurement methodologies including job/practice analysis, item analysis/calibration, forms assembly, standard setting, and test security.
Familiarity with Classical Test Theory, Rasch Measurement, and/or Item Response Theory.
Strong quantitative skills and exemplary attention-to-detail with a demonstrated ability to produce accurate psychometric results under tight deadlines.
Strong interpersonal and communication skills (oral and written) with demonstrated ability to work effectively with individuals who have varying levels of measurement expertise.
Proficiency with software and statistical analysis and programming tools (e.g., R, SPSS,), and Rasch/IRT software (e.g., Winsteps, Xcalibre, Parscale).

Responsibilities

Performs routine psychometric analyses on the performance of examinations and continuing education programs using Classical Test Theory, Rasch Measurement, and Item Response Theory.
Manipulate, analyze, and maintain large data sets.
Document results of examination and continuing education analyses.
Leads and supports measurement activities across job analysis studies, test specification validation, standard setting, and test security, exercising independent judgment in methodology selection and execution.
Conducts quality control of scoring processes for both computer-delivered and paper-and-pencil test administrations and contribute to the development of requirements and user acceptance testing for test-generation, scoring, and statistical systems.
Serves as a subject matter expert and internal resource on assessment, psychometric, and data analytic methodologies, including proficient use of FINRA’s proprietary item banking and test delivery system.
Maintains deep, current knowledge of measurement theory and emerging developments in psychometric, proactively identifying innovations that may enhance test delivery, exam construction, measurement accuracy, and test security.
Designs and conducts ad hoc and research-driven analyses with direct application to FINRA and client programs, translating complex findings into actionable insights for senior staff and management.
Applies advanced analytical skills to support the full lifecycle of examination program operations, from test construction and scoring through ongoing program evaluation and continuous improvement.
Demonstrates FINRA’s values.
Collaborates, both in-person and virtually, in furtherance of FINRA’s mission of investor protection and market integrity.

Benefits

Discretionary bonus
Overtime pay
Comprehensive health insurance
Dental insurance
Vision insurance
Basic life insurance
Accidental death and dismemberment insurance
Supplemental life insurance
Spouse/domestic partner and dependent life insurance
Spouse/domestic partner and dependent accidental death and dismemberment insurance
Short-term disability insurance
Long-term disability insurance
Long-term care insurance
Business travel accident insurance
Disability insurance
Legal insurance
Immediate participation and vesting in a 401(k) plan with company match
FINRA-funded retirement contribution
Tuition reimbursement
Commuter benefits
Adoption assistance
Backup family care
Surrogacy benefits
Employee assistance program
Wellness programs
15 days of paid time off (increasing with years of service, up to 25 days)
5 personal days
9 sick days
Two volunteer service days
Military leave
Jury duty leave
Bereavement leave
Voting and election official leave
Care of a family member leave
Childbirth and parental leave
Nine paid holidays