Exam Developer

Casualty Actuarial Society•Arlington, VA

3d•$0 - $83,000

About The Position

The Exam Developer supports the CAS examination-construction process to help ensure exams are reliable, fair, valid, and aligned with testing-industry standards. The role works closely with the CAS Certification team, Exam Working Groups, task forces, and third-party testing vendors. It contributes across the CAS certification-development lifecycle, including exam construction, item-bank management, security, publishing, and the development and management of assessments and services offered by Admissions. The role supports assessment development, exam assembly and production, and operational processes. It helps manage item development and translation workflows, review and assemble exam forms, coordinate publishing with vendors, conduct quality-control checks, and maintain the security of examination materials and confidential information. It also maintains process documentation, monitors program performance metrics, supports meetings and team operations, and delivers work in accordance with CAS project timelines and annual performance goals.

Requirements

At least three years of experience as an Exam Developer or in a comparable position; association or member-service experience is preferred.
At least three years of knowledge of testing and certification assessment practices to accepted industry standards.
Ability to manage a high volume of tasks with excellent attention to detail and accuracy.
Excellent time-management skills and ability to coordinate and prioritize production-oriented tasks.
Excellent communication skills for interacting with the certification team, volunteer working groups, task forces, and candidates.
Ability to work in a changing environment.
Experience in project, vendor, and volunteer management.
Advanced proficiency in Microsoft Office applications.
Knowledge of computer applications for database management and data analysis.
Knowledge of item-banking and publishing software.
Ability to travel up to 10%.

Nice To Haves

A four-year, fully accredited bachelor's degree in Education, Measurement & Statistics, I/O Psychology, or a related field is preferred.
Experience with ISO 17024 standards for certification programs.
Proficiency in Cobalt.
Experience with Pearson's ExamDeveloper software.

Responsibilities

Support practice-analysis projects and internal blueprint creation.
Edit exam items to meet psychometric, organizational, grammar, and spelling standards.
Support item-development processes and workflows, and work with Certification Program Managers to maintain the item bank.
Manage translation development for exams when needed, coordinating with third-party vendors and volunteers.
Maintain quality control, accountability, and examination integrity throughout the examination process.
Manage exam and assessment publishing with the testing-delivery vendor and other CAS departments or third-party vendors.
Assemble and review exam forms and provide formal acceptance to the testing-delivery vendor.
Produce electronic assessment forms for the test-delivery vendor and conduct quality-control checks on forms assembled by that vendor.
Assist Certification Analysts with setting up exam-grading rubrics and solution files.
Maintain the security of the item bank, exam forms, and confidential candidate and vendor information.
Develop and maintain a robust security program with support from the Certification Development team.
Maintain form-creation and publishing sections of the Exam Development Processes and Policies document.
Maintain written instructions and standard operating procedures for assigned key functions.
Support in-person meetings and logistics as needed.
Monitor and analyze program-specific performance metrics.
Support program operations and consistency between key development transition points.
Handle other projects and assist other CAS Office operating areas as assigned.
Deliver work in accordance with CAS project timelines and annual performance goals.