Psychometrician (Fully Remote)

FYI For Your Information Inc•Silver Spring, MD

10d•Hybrid

About The Position

We are seeking a Senior I/O Psychologist/Psychometrician with a master's degree in I/O Psychology and at least 10 years of experience to lead the design, validation, and continuous improvement of personnel assessment tools supporting federal hiring and selection. The ideal candidate conducts job analyses, develops psychometrically sound assessment instruments, performs validity studies, and ensures full compliance with UGESP, OPM Merit System Principles, and Delegated Examining requirements, while providing expert consultation to HR specialists and hiring managers on evidence-based selection practices.

Requirements

A master's degree in I/O Psychology is required.
At least 10 years of demonstrated experience in design, validation, implementation, and continuous improvement of personnel assessment tools to support hiring and selection of personnel.

Responsibilities

Conduct comprehensive job analyses to identify and document the critical duties, tasks, competencies, and qualification requirements that form the foundation for all assessment tools.
Develop assessment strategies and plans, ensuring all instruments (e.g., structured interviews, occupational questionnaires, work samples) are appropriately mapped to job related competencies and aligned to organizational hiring objectives.
Design and develop assessment content, including test items, scoring rubrics, structured interview questions, benchmarks, evaluation criteria, and rating scales that adhere to psychometric and professional testing standards.
Evaluate assessment tools for quality and compliance, ensuring adherence to the Uniform Guidelines on Employee Selection Procedures (UGESP), OPM Merit System Principles, Delegated Examining requirements, and agency hiring policies.
Conduct pilot testing and psychometric analyses, including reliability analysis, item level statistics, validity evaluations, scoring calibration, and recommended revisions based on empirical evidence.
Perform validity studies (content, criterion-related, and/or construct), documenting the relationship between test scores and job performance and ensuring defensibility of selection procedures.
Monitor and analyze adverse impact, identify potential areas of risk, recommend mitigation strategies, and document compliance with equal employment opportunity and nondiscrimination standards.
Prepare technical documentation, including validation reports, assessment plans, administration protocols, scoring guides, and auditable compliance documentation suitable for legal and regulatory review.
Provide training and consultation to HR specialists, hiring managers, and subject matter experts on assessment administration, scoring procedures, SME calibration, and best practices for evidence-based hiring.
Perform ongoing evaluation and continuous improvement, including updates to assessment tools, re-validation as needed, and analysis of assessment effectiveness over time.
Ensure secure handling of assessment materials, protecting sensitive and pre-decisional content in accordance with Federal information security policies and agency guidelines.