Exam Developer

Casualty Actuarial Society•Arlington, VA

About The Position

The Exam Developer supports the CAS examination construction process to ensure assessments are reliable, fair, valid, and aligned with testing industry standards. The role works closely with the CAS Certification team, Exam Working Groups, task forces, and third-party testing vendors. It contributes across the certification development lifecycle, including exam construction, item bank management, examination security, and publishing, and supports the development, implementation, and management of assessments and services offered by Admissions. The position supports assessment development, exam assembly and production, scoring and analysis, reporting, and operational processes. It helps maintain examination integrity and confidential information, manages publishing activities with testing vendors, and supports program operations and consistency across development milestones. Accountability is measured by delivery against CAS project timelines and annual performance goals.

Requirements

A minimum of three years of experience as an Exam Developer or in a comparable position.
At least three years of knowledge of testing and certification assessment practices aligned with accepted industry standards.
Ability to manage a high volume of tasks with excellent attention to detail and accuracy.
Excellent time management skills and ability to coordinate and prioritize production-oriented tasks.
Excellent communication skills for interacting with the certification team, volunteer working groups, task forces, and candidates.
Ability to work in a changing environment.
Experience in project, vendor, and volunteer management.
Advanced proficiency in Microsoft Office applications.
Knowledge of computer applications for database management and data analysis.
Knowledge of item banking and publishing software.
Ability to travel up to 10%.

Nice To Haves

A four-year fully accredited bachelor's degree in Education, Measurement & Statistics, I/O psychology, or a related field is preferred.
Experience in an association or member-service-oriented environment is preferred.
Experience with ISO 17024 standards for certification programs.
Proficiency in Cobalt.
Experience with Pearson's ExamDeveloper software.

Responsibilities

Support practice analysis projects and internal exam blueprint creation.
Edit examination items to meet psychometric, organizational, grammar, and spelling standards.
Support the item development process and workflow.
Work with Certification Program Managers to maintain the item bank.
Manage translation development for exams requiring translations, liaising with third-party vendors and volunteers as needed.
Ensure quality control, accountability, and examination integrity throughout the examination process.
Manage exam and assessment publishing with the testing delivery vendor and other CAS departments or third-party vendors.
Assemble and review exam forms and provide formal acceptance to the testing delivery vendor.
Produce electronic assessment forms for the test delivery vendor and conduct quality control checks on forms assembled by the vendor.
Assist Certification Analysts with setting up exam grading rubrics and solution files.
Maintain the security of the item bank, exam forms, and confidential candidate and vendor information.
Develop and maintain a robust security program with support from the Certification Development team.
Maintain form-creation and publishing sections of the Exam Development Processes and Policies document.
Maintain written instructions and standard operating procedures for key functions owned by the role.
Support in-person meetings and logistics as needed.
Monitor and analyze program-specific performance metrics.
Support program operations and consistency between key transition points in development.
Handle other projects and assist other operating areas of the CAS Office as assigned.
Deliver work in accordance with CAS project timelines and annual performance goals.