Exam Development Manager

International Society of Arboriculture-posted about 1 month ago

Full-time • Manager

Atlanta, GA

11-50 employees

Resume

Match Score

Upload and Match ResumeTrack Jobs with Teal

The Examinations Development Manager is responsible for compliance with documented polices and procedures as it pertains to exam development and maintenance. He/she/they will work with Subject Matter Experts (SMEs), stakeholders, vendors, and staff to develop and maintain examinations at standardized rigor for continued assurance of validity and reliability as well as fairness and impartiality and meeting relevant and required standards (e.g., ISO/ICE 17024, ASTM E2659). The Examinations Development Manager is charged with meeting the needs of ISA’s current and future credential holders by managing the development and maintenance of all ISA’s credentialing examinations (including both written and performance-based examinations). This is accomplished by utilizing experience in exam development and maintenance, data analysis, psychometrics and testing, volunteer recruitment and engagement, and project management.

Contributes to the departmental strategic planning process and collaborates with the Director of Credentialing Services to provide leadership in the implementation of the ISA strategic plan and department priorities.
Responsible for all credentialing exams including the maintenance, development, and security of the Exam Item Banks.
Ensures the performance of job task analysis as directed by associated documented policies and procedures.
Oversees question/item development, maintenance, and translations.
Ensures exam and psychometric data is collected for performance and delivery of item analyses and maintenance, collusion analyses (and other exam forensic tests, if needed), and exam form creation.
Lead and serves as main liaison to all Credentialing SME Committees (e.g., ISA Test Committee, ISA BCMA Test Committee).
Assists the Director of Credentialing Services in supporting the Credentialing Council and maintenance of ISA’s accreditation with ANAB.
Stays current with and utilizes best management practices for examination development and ensures that the ISA remains compliant with ISO/IEC 17024 standard and any other relevant standards applicable to ISA credentialing programs (e.g., ASTM E2659).
Ensures a strict divider or “firewall” remains intact to protect test security and confidentiality of examination/test banks during question development and maintenance.
Recruits, develops and maintains a highly involved contingent of volunteers who provide input and assistance in the development and maintenance of examinations.
Develops professional relationships with appropriate industry stakeholders, fellow staff members, volunteers, vendors, and others in the credentialing industry.
Utilizes external services to support and ensure that quality credentialing examinations are developed and maintained in a psychometrically sound, legally defensible manner.
Maintains a high level of test security and confidentiality to ensure overall program integrity and impartiality.
Fosters an environment of continuous improvement. Encourages staff to look for ways to improve department policies, procedures, processes and operations that result in improved efficiencies and a positive experience for ISA candidates and credential holders.
Oversees the daily transfer of appropriate Computer Based Testing and Paper and Pencil exam data and statistics into test banking software according to departmental policies and procedures.
Gather and analyze exam performance data in order to make recommendations for improvements and initiatives for consideration by the Director of Credentialing.
Serves as point person for examination publication and as the Computer Based Testing vendor’s main point of contact with ISA.
Complies with ISO/IEC 17024 to prevent fraudulent examination practices, monitor examination statistics to ensure the integrity of the examination process, and works with vendors (if applicable) to investigate security incidents, breaches, and other concerns related to exam security.
Ensures examination questions are designed to measure competence based on, and consistent with, the scheme for each given credential.
Ensures examination forms (including forms associated with performance-based examinations) have comparability of results for each single examination, both in content and difficulty, including validity of fail/pass decisions.
Oversees the performance of all processes associated with examination design, development, and maintenance.
Trains Subject Matter Experts (SMEs) on current best management practices for item development and review.
Serves as main point of contact for translators, editors, and SMEs working on item development, review, and translation.
Anticipate item and test development needs for all ISA examinations and build multi-year plans to meet those needs.
Facilitate SME Committee meetings (virtual and in-person) related to item and exam development.
Manage Committee review and approval of examination items and exam forms in a timely and cyclical fashion according to documented policies and procedures.
Responsible for item bank management system, ensuring statistical data is available to inform and report on item and exam development activities and needs.
Ensure exam development process documentation is kept current and accurate.
Work with Publication and Documentation Lead and other key staff to ensure that relevant policies, procedures and communication is updated and accurate with regard to examinations (e.g., credentialing schemes, exam outlines, cut scores)

Contributes to the departmental strategic planning process and collaborates with the Director of Credentialing Services to provide leadership in the implementation of the ISA strategic plan and department priorities.
Responsible for all credentialing exams including the maintenance, development, and security of the Exam Item Banks.
Ensures the performance of job task analysis as directed by associated documented policies and procedures.
Oversees question/item development, maintenance, and translations.
Ensures exam and psychometric data is collected for performance and delivery of item analyses and maintenance, collusion analyses (and other exam forensic tests, if needed), and exam form creation.
Lead and serves as main liaison to all Credentialing SME Committees (e.g., ISA Test Committee, ISA BCMA Test Committee).
Assists the Director of Credentialing Services in supporting the Credentialing Council and maintenance of ISA’s accreditation with ANAB.
Stays current with and utilizes best management practices for examination development and ensures that the ISA remains compliant with ISO/IEC 17024 standard and any other relevant standards applicable to ISA credentialing programs (e.g., ASTM E2659).
Ensures a strict divider or “firewall” remains intact to protect test security and confidentiality of examination/test banks during question development and maintenance.
Recruits, develops and maintains a highly involved contingent of volunteers who provide input and assistance in the development and maintenance of examinations.
Develops professional relationships with appropriate industry stakeholders, fellow staff members, volunteers, vendors, and others in the credentialing industry.
Utilizes external services to support and ensure that quality credentialing examinations are developed and maintained in a psychometrically sound, legally defensible manner.
Maintains a high level of test security and confidentiality to ensure overall program integrity and impartiality.
Fosters an environment of continuous improvement. Encourages staff to look for ways to improve department policies, procedures, processes and operations that result in improved efficiencies and a positive experience for ISA candidates and credential holders.
Oversees the daily transfer of appropriate Computer Based Testing and Paper and Pencil exam data and statistics into test banking software according to departmental policies and procedures.
Gather and analyze exam performance data in order to make recommendations for improvements and initiatives for consideration by the Director of Credentialing.
Serves as point person for examination publication and as the Computer Based Testing vendor’s main point of contact with ISA.
Complies with ISO/IEC 17024 to prevent fraudulent examination practices, monitor examination statistics to ensure the integrity of the examination process, and works with vendors (if applicable) to investigate security incidents, breaches, and other concerns related to exam security.
Ensures examination questions are designed to measure competence based on, and consistent with, the scheme for each given credential.
Ensures examination forms (including forms associated with performance-based examinations) have comparability of results for each single examination, both in content and difficulty, including validity of fail/pass decisions.
Oversees the performance of all processes associated with examination design, development, and maintenance.
Trains Subject Matter Experts (SMEs) on current best management practices for item development and review.
Serves as main point of contact for translators, editors, and SMEs working on item development, review, and translation.
Anticipate item and test development needs for all ISA examinations and build multi-year plans to meet those needs.
Facilitate SME Committee meetings (virtual and in-person) related to item and exam development.
Manage Committee review and approval of examination items and exam forms in a timely and cyclical fashion according to documented policies and procedures.
Responsible for item bank management system, ensuring statistical data is available to inform and report on item and exam development activities and needs.
Ensure exam development process documentation is kept current and accurate.
Work with Publication and Documentation Lead and other key staff to ensure that relevant policies, procedures and communication is updated and accurate with regard to examinations (e.g., credentialing schemes, exam outlines, cut scores)

Track Jobs with Teal

Job Search Resources

•

Resume Builder

•

Business Development Manager Resume Examples

•

Business Development Manager Cover Letter Examples

Exam Development Manager

Job Search Resources

Tools

Career Hubs

Guides

Company