Specialist, Certification Exam Developer

Association For Materials Protection And Performance•Houston, TX

9d•Hybrid

About The Position

The Certification Exam Developer position is responsible for the development, maintenance, and performance monitoring of AMPP certification examinations including exam updates. In addition, the role will be required to perform facilitation of in-person and virtual meetings with subject matter experts to ensure that the end-result is based on actual job role requirements. Examples of tasks include exam development, item writing, item referencing, item bank maintenance, preparation of materials for item review and preparation of exam forms for Test Production. This individual will also ensure that all exams meet or exceed legal defensibility process and policy requirements as stipulated by the AMPP Certification program office. Detailed focus on items quality and exam security is central to this role.

Requirements

Masters degree in Psychometrics, Educational Psychology, Psychology or equivalent experience
1-3 years professional test development experience
Strong knowledge of all Microsoft Office products
Item and Test Development experience is required.
Ability to read, analyze, and interpret general business periodicals, professional journals, technical procedures, or governmental regulations.
Ability to write reports, business correspondence, and procedure manuals.
Ability to effectively present information and respond to questions from groups of managers, members, employees of the organization, customers, and the general public.
Ability to calculate figures and perform item analysis using test development psychometrics.
Ability to apply concepts such as fractions, percentages, ratios, and proportions to practical situations.
Ability to develop and interpret business graphs.
Ability to solve practical problems and deal with a variety of concrete variables in situations where only limited standardization exists.
Ability to interpret a variety of instructions furnished in written, verbal, diagram, or schedule form.
Must possess a specific level of communication skill both verbal and written.
Ability to work in a multi-task environment taking into account various external factors and to communicate efficiently and accurately to both managers/supervisors and stakeholders.
Project management
Communication and presentation
Demonstrated proficiency in Microsoft Office products and database software
Excellent written and verbal communication and interpersonal skills
Ability to think globally
Excellent attention to detail and accuracy
Ability to prioritize and handle multiple projects simultaneously
Ability to work under pressure and meet exacting deadlines
Proven dependability and high regard for security
Negotiating with vendors
Working within the budget and tracking expenses
Strong facilitation skills
Strong editorial skills

Nice To Haves

1-3 years’ Job Task Analysis experience, highly preferred
A background in the testing and assessment industry is strongly preferred.
Statistical Item analysis (not required / nice to have - will be required to learn)
Global business and member driven association experience a plus

Responsibilities

Organize and assist in the facilitation of face-to-face competency modeling workshops.
Keep current the competency model that delineates performance and knowledge/skills used as the basis for development of exams.
Breakdown tasks that make up a specific role, based on input by subject matter experts (SMEs) who are currently performing that function.
Organize and conduct face-to-face or remote item development workshops.
Manage vendor-produced exam development work, activities, and deliverables.
Train subject matter experts and vendors on writing technically sound exam items.
Create items (questions) to ensure test takers meet a defined level of performance and knowledge/skills.
Oversee item review for technical content, validity, items standards, and grammatical.
Prepare the item bank for final exam publishing and ensure there is a complete Exam Preparation Guide (EPG).
Organize and assist in the facilitation of standard setting workshops.
Manage SMEs recruiting, scheduling, set up and administration of exam and ratings in Exam Developer.
Monitor the continued validity and reliability of exams during the period in which they are active.
Track the performance of exams and items; when necessary, revise and/or remove items.
Verify that the exams meet the target audience and program needs.
Manage development of certification exams.
Organize and facilitate project meetings, develop status reports, manage schedules and deadlines, initiate and maintain strategic relationships and partnerships.
Assure quality of deliverables
Collaborate with Exam development coordinator when responding to Certification Exam mailbox, posting volunteer opportunities, and workshop logistics.
Implement appropriate methods for translating exams to maintain test security, reduce bias and improve quality.
Work with the Boards to recruit SMEs, program changes and initiatives