Psychometrician / Student Assessment Development Specialist

Team Carney • Quantico, VA

1d • Onsite

About The Position

Carney is seeking a highly analytical Psychometrician / Student Assessment Development Specialist to lead training needs assessments, test construction, validation, and empirical measurement across JCITA’s training enterprise at Quantico, VA. The role develops statistically sound assessment instruments, oversees exam integrity within secure facilities, and conducts test-item and trend analyses to validate student achievement and brief executive stakeholders. The position is based at the Russell Knox Building in Quantico and is 100% on-site in a SCIF environment. An active, verified Top Secret / Sensitive Compartmented Information (TS/SCI) clearance is required at the time of proposal and award.

The role requires a master’s degree in Psychology with a specialization in Industrial/Organizational Psychology, Organizational Behavior, Personality Research, or Quantitative Methods, or an equivalent graduate degree in educational measurement/psychometrics. Candidates must have at least three years of dedicated experience developing student assessment instruments, constructing valid test rubrics, or conducting formal training needs analysis, along with hands-on Microsoft Excel proficiency and strong executive-report writing skills.

Requirements

• Hold an active, verified Top Secret / Sensitive Compartmented Information (TS/SCI) clearance at the time of proposal and award.
• Have a master’s degree in Psychology specializing in Industrial/Organizational Psychology, Organizational Behavior, Personality Research, or Quantitative Methods, or an equivalent graduate degree in educational measurement/psychometrics.
• Have a minimum of three years of dedicated experience developing student assessment instruments, constructing valid test rubrics, or conducting formal training needs analysis.
• Demonstrate hands-on proficiency using Microsoft Excel for complex statistical analyses, trend reporting, data structuring, and visualization.
• Demonstrate excellent written communication skills and the ability to distill complex empirical findings into clear executive reports.

Nice To Haves

• Prior experience conducting psychometric validation for federal law enforcement, military, or intelligence training programs.
• Working knowledge of specialized statistical analysis software such as SPSS, R, or Python alongside advanced Excel modeling.
• Experience presenting empirical findings to senior military flag officers and Defense Senior Executive Service (SES) leaders.

Responsibilities

• Design, build, and validate objective student assessment instruments, including criterion-referenced written exams, performance rubrics, and practical exercise evaluation scorecards.
• Conduct and participate in training needs analyses, practice analyses, and task analyses (CDRL A014) to define observable, measurable student performance requirements.
• Perform classical and modern test item analyses, including item difficulty, discrimination indices, and reliability coefficients, to optimize exam item banks and identify testing anomalies.
• Aggregate and analyze end-of-course (EOC) student evaluations and curriculum survey data, and draft analytical summaries within two days of survey receipt (CDRL A011).
• Author executive-level metric and evaluation briefings, including the Annual EOC Metrics Report (CDRL A013) and the Annual Board of Governors Report (CDRL A012).
• Advise JCITA leadership, academic deans, and course chairs on testing policy, remediation pathways, test security, and psychometric standards.
• Ensure testing architectures uphold Council on Occupational Education (COE) accreditation criteria and defense counterintelligence academic policies.

What This Job Offers

• Job Type: Full-time