Director of Student Assesment, School of Medicine - Full-time CFS Professional Faculty

Brigham Young University•Provo, UT

6d•Onsite

About The Position

The Director of Student Assessment, School of Medicine - Full-time CFS Professional Faculty will oversee the comprehensive assessment system for all three phases of the MD curriculum. This role involves directing the design, implementation, and continuous improvement of assessment systems to ensure they accurately measure cognitive achievement, competency attainment, and steady progression toward graduation outcomes. The Director will maintain alignment between internal exams, clerkship assessments, and program-level assessments, while also developing a programmatic assessment framework that integrates multiple measures of learner performance. This position requires ensuring assessment methods are valid and support competency-based progression decisions, and monitoring alignment with institutional competencies, EPA frameworks, graduation objectives, and LCME standards. The Director will provide strategic oversight for assessment planning and associated personnel. Additionally, the role involves developing and maintaining policies, procedures, and guidelines related to student assessment, grading, remediation, progression, and promotion, ensuring compliance with LCME accreditation standards and School of Medicine policies. The Director will serve as an assessment subject-matter expert for the School of Medicine Curriculum Committee and chair the Assessment Subcommittee. The position also oversees the collection, integration, validation, analysis, and reporting of assessment data, providing expertise for learner performance dashboards. The Director will monitor assessment data from various sources, ensure secure and ethical data handling, and analyze outcomes to support academic decision-making and curriculum improvement. Strategic leadership for assessment operations, examination administration, and collaboration with faculty and staff on psychometric analyses and training are key responsibilities. The role also supports student progression and support processes, monitors emerging best practices in medical education assessment, and recommends innovations in assessment tools and methodologies. The Director may also be assigned additional responsibilities within the School of Medicine, including teaching, curriculum review, and committee service.

Requirements

Doctoral degree (PhD, EdD, MD, DO, or equivalent). The required degree must be completed by the start date.
Minimum of 7 years of progressively responsible experience in educational assessment, evaluation, medical education, or academic program administration.
Alignment with and commitment to the mission, values, and spiritual aims of Brigham Young University and The Church of Jesus Christ of Latter-day Saints.
This position requires the successful candidate to relocate and/or reside in Utah for the duration of their employment.

Nice To Haves

Experience within undergraduate or graduate medical education.
Demonstrated experience with competency-based medical education and accreditation processes of the LCME or COCA.
Experience working with NBME assessments, USMLE performance data, and assessment benchmarking.
Experience leading assessment, curriculum, or accreditation committees.
Demonstrated experience with psychometric analysis.
Experience implementing assessment management systems and educational analytics platforms.

Responsibilities

Oversee Comprehensive Assessment System: Direct the design, implementation, and continuous improvement of assessment systems across all three phases of the MD curriculum.
Ensure assessments measure cognitive achievement, competency attainment, and steady progression toward graduation outcomes.
Maintain alignment between internal summative Phase 1 exams, clerkship assessment (primarily NBME shelf exams), and program-level assessments (NBME USMLE Step exams and essential assessments).
Oversee and develop a programmatic assessment framework that integrates multiple measures of learner performance across all phases of the curriculum.
Ensure assessment methods are valid and support competency-based progression decisions.
Monitor alignment of assessments with institutional competencies, EPA frameworks, graduation objectives, and LCME standards.
Provide strategic oversight for assessment planning and associated personnel.
Assessment Governance and Policy Development: Develop and maintain policies, procedures, and guidelines related to student assessment, grading, remediation, progression, and promotion to be approved by the curriculum committee.
Ensure assessment practices comply with LCME accreditation standards and School of Medicine policies.
Serve as an assessment subject-matter expert for the School of Medicine Curriculum Committee.
Chair the Assessment Subcommittee, facilitating meetings, coordinating assessment initiatives, and advancing recommendations related to student assessment, grading, progression, and continuous quality improvement to be approved by the Curriculum Committee.
Decision Support: Oversee the collection, integration, validation, analysis, and reporting of assessment data from all assessment sources across the curriculum.
Provide subject-matter expertise for the development of comprehensive learner performance dashboards that provide a longitudinal view of student achievement, competency attainment, progression, and readiness for advancement.
Monitor assessment data from multiple sources, including internal multiple-choice examinations, formative assessments, NBME subject examinations, OSCEs and simulation-based assessments, clinical performance evaluations, workplace-based assessments, and other assessment methods utilized throughout the curriculum.
Ensure secure, ethical, and FERPA-compliant handling of student performance data.
Analyze assessment outcomes, performance trends, student progression, competency attainment, and national benchmark results through assessment dashboards and other reporting tools to support academic decision-making, student success initiatives, and continuous curriculum improvement by making recommendations to School of Medicine leadership.
Monitor longitudinal trends in NBME subject examinations, CBSE, USMLE Step examinations, and other benchmark assessments, and provide assessment-based recommendation to School of medicine leadership to support continuous curriculum improvement.
Analyze assessment results to identify content gaps, curricular strengths and weaknesses, and opportunities for improvement in assessment design and student performance.
Design reports and dashboards that incorporate psychometric and assessment quality metrics to support data-informed decision-making by faculty, curriculum committees, and institutional leadership.
Assessment Operations and Examination Administration Leadership: Provide strategic leadership and oversight for student assessment operations across all phases of the curriculum.
Coordinate with phase administrators, course directors, clerkship directors, and support staff to ensure efficient, secure, and consistent examination administration processes.
Oversee processes related to examination scheduling, testing accommodations, examination security, approved make-up examinations, and post-examination review activities.
Monitor standardized procedures for assessment administration across the curriculum to ensure consistency, fairness, and compliance with institutional policies.
Serve as the institutional lead and subject-matter expert for assessment delivery platforms, including VidaNova, NBME systems, and other assessment technologies utilized throughout the curriculum.
Monitor assessment operations across all phases and recommend improvements to increase efficiency, standardization, reliability, and effectiveness.
Develop and maintain student and faculty resources, training materials, and communications regarding examination administration procedures, assessment technologies, testing accommodations, examination security, and related policies.
Faculty and Staff Collaboration: Lead psychometric analyses and examination quality reviews in collaboration with course and clerkship directors, including evaluation of item difficulty, discrimination, reliability, blueprint alignment, score distributions, and overall assessment effectiveness.
Provide consultation and training to course and clerkship directors on assessment design, grading, feedback, and evaluation methods.
Collaborate with educational leadership to align assessments with instructional strategies.
Support faculty development initiatives related to assessment literacy and facilitate faculty development related to competency-based assessment, constructive feedback, rubric design, and workplace-based assessment.
Provide consultation regarding assessment validity, reliability, standard setting, and defensible pass/ fail decisions.
Provide consultation to curriculum leadership regarding assessment technologies, examination delivery methods, and assessment administration processes.
Collaborate with course and clerkship directors to optimize assessment implementation and ensure consistency across phases of the curriculum.
Develop and deliver educational programming for faculty, staff, and students regarding assessment policies, processes, technologies, and best practices.
Provide guidance to faculty on assessment design, item writing, blueprinting, standard setting, constructive feedback, and assessment literacy.
Educate students regarding assessment expectations, examination processes, scoring methodologies, and performance reporting.
Student Progression and Support Processes: Support remediation, advancement, and promotion processes of students through effective collaboration with the Office of the Dean of Student Progress.
Collaborate with the Offices of Student Progress and Student Experience and Well-Being to identify trends and early concerns around student performance and progress.
Ensure transparent communication of assessment expectations and processes to students.
Provide oversight of student assessment data and reporting to ensure accurate, reliable, and comprehensive performance information is available for MPSE development.
Partner with the Dean of Student Progress and Curriculum leadership to synthesize assessment outcomes, support competency-based evaluation, and ensure the MPSE reflects a fair and holistic view of student achievement.
Continuous Quality Improvement and Innovation: Monitor emerging best practices in medical education assessment.
Recommend innovations in assessment tools, technologies, and methodologies.
Contribute to continuous quality improvement initiatives at the program and institutional level.
Evaluate and recommend assessment technologies, analytics tools, and operational processes that improve assessment quality, reporting capabilities, and learner outcomes.
Collaborate with educational leadership to evaluate, improve, and implement assessment tools, methods, technologies, and workflows that enhance assessment quality and improve the student experience across all phases of the curriculum.
May be assigned additional responsibilities within the School of Medicine, including participation in teaching, curriculum review, committee service, and other institutional initiatives.