Assessment Development Specialist

Prometric

32d•Remote

About The Position

The Assessment Development Specialist (ADS) is a key member of the Assessment Solutions Department. This position is responsible for developing and maintaining examinations for professional certification and licensing and K12 assessment. The ADS is expected to work collaboratively, both in person and virtually, with other members of the Assessment Development & Psychometrics team and cross functionally with the publishing, PMO, account management, and business development teams in scheduling work and gathering requirements to ensure the production of reliable and valid tests. Specifically, an Assessment Development Specialist is responsible for multiple aspects of the assessment development life cycle, including but not limited to training and managing external item writers, writing and editing test items, developing test specifications/test objectives according to industry best practices, supporting test form assembly, maintaining the item bank, preparing materials for workshops, and organizing exam content for test production.

Requirements

Minimum of three years of experience in assessment development, preferably in K-12 or certification/licensure contexts.
Excellent written, verbal, and interpersonal communication skills.
Experience with group facilitation and conducting workshops such as in-person meetings or by web/teleconferences.
Experience with test blueprints, content development, form assembly processes, standard setting techniques, bias and sensitivity reviews, and statistical analysis methods.
Knowledge of validity theory and measurement concepts.
Familiarity with standards and regulatory requirements in the K-12 and certification/licensure industries.
Proficiency in using assessment development software and tools.
Ability to prioritize and handle multiple projects simultaneously, work under pressure, and meet exacting deadlines.
Ability to meet quality and productivity metrics.
Excellent attention to detail and accuracy; proven dependability and high regard for security.
Strong organization and time management skills.
Ability to work occasional weekends and evenings, as well as to travel as needed (potentially up to 20%).
Strong technical and full proficiency in Microsoft Office Suite (Word, Excel, PowerPoint, Outlook), Google Workspace (Docs, Sheets), and Adobe PDF tools.

Responsibilities

Design and develop assessments that align with learning objectives and standards for K-12 and certification/licensure programs.
Collaborate with subject matter experts (SMEs) to ensure the accuracy and relevance of assessment content.
Apply psychometric principles and measurement theory to ensure assessments are statistically sound and fair across diverse populations.
Develop item banks and assess item quality based on reliability, validity, and alignment with content standards.
Lead the creation of scoring rubrics and performance criteria for various types of assessments.
Oversee form assembly by organizing and managing the selection and arrangement of items into coherent and reliable test forms that meet content specifications and psychometric standards.
Ensure appropriate balance and representation of content across forms, while adhering to time constraints and operational requirements.
Collaborate with stakeholders to conduct form reviews and quality checks to ensure reliability, validity, and fairness across all test forms.
Conduct bias and sensitivity reviews to identify and mitigate potential sources of bias, ensuring the assessments are equitable and inclusive for all test takers.
Manage the end-to-end development process of assessments.
Contribute to the development of assessment reports, including data analysis and interpretation of test results.
Update and manage items in the item bank to ensure all item data is current.
Represent Assessment Services in client meetings and in internal departmental and cross-functional meetings
Work closely with assessment services managers, other assessment development specialists, assessment design specialists, and psychometricians.
Become proficient with Prometric’s internal, proprietary assessment technology; follow established procedures and guidelines, and comply with exam security practices.
Other duties as assigned.