Kaiser Permanente-posted 3 months ago
Pasadena, CA
Ambulatory Health Care Services

The Assessment Program Supervisor is responsible for managing the assessment program to generate and optimally utilize assessment data at the Kaiser Permanente Bernard J. Tyson School of Medicine (KPSOM). This includes informing decisions about student achievement, supporting students in their academic progress, and providing insights into curriculum and assessment strengths and gaps to faculty, administrators, and students. This role trains faculty on assessment data, conducts analysis, promotes equity, inclusion and diversity in the assessment program, and supports educational scholarship. This role will interface with Information Technology (IT) in the design and maintenance of analytics to support assessment-related efforts.

  • Provide support for faculty development through assessment data interpretation and utilizing assessment data and dashboards in the Curriculum as a Whole review, Phase Reviews, and other curricular evaluation efforts.
  • Coordinate and execute Competency Committee Review Processes for each Phase, including faculty development, data preparation and presentation, process review, and meeting facilitation.
  • In collaboration with IT, contribute to the ongoing development and maintenance of assessment related dashboards, including ensuring the creation and integrity of data flowing into the system from the Learning Management System (LMS) and other sources, and participating in the design of new dashboards and enhancements to the existing system.
  • Provide staff and faculty development to support the creation of accurate and aligned assessment data.
  • Research and monitor trends in health professions and medical education assessment design and methodologies, and communicate findings to the Office of Assessment and Evaluation (OAE) leadership.
  • Monitor project plan execution, addressing barriers and collaborating with OAE leadership to ensure necessary resources and timely completion, escalating concerns as needed.
  • Collaborate on the writing and production of the Medical Student Performance Evaluation letters (MSPE) and ensure effective project management.
  • Manage OAE support for National Board of Medical Examiners (NBME) products, including exams, testing blueprints, conduct web-based item review meetings with faculty, and inform course reviews process.
  • Oversee the preparation and provision of assessment data for reviews of courses, Phases and the Curriculum as a Whole.
  • Conduct analyses of assessment data as directed by OAE leadership for equity, validity, reliability, time trends, and curricular evaluation.
  • Coordinate and present student performance data, analyses, and visualizations for various academic and oversight teams, committees, and curricular governance bodies.
  • Oversee the timely in-house cataloguing and analysis of NBME score reports and annual summaries, and the uploading of NBME program level assessment data into the Learning Management System.
  • Ensure data management systems comply with regulatory requirements and institutional data governance guidelines.
  • Provide consultation and support as able to Objective Structured Clinical Examination (OSCE) assessment system and data analysis.
  • Supervise and coordinate daily activities of designated work team by monitoring the execution and completion of action items and work assignments; ensures all policies and procedures are followed.
  • Align team efforts and standards, and measure progress in achieving results; determine and carry out processes and methodologies; resolve escalated issues as appropriate.
  • Solicit and act on performance feedback; provide team members with feedback; and mentor and coach to drive performance improvement.
  • Pursue professional growth; provide training and development to talent for growth opportunities; support execution of performance management guidelines and expectations.
  • Implement, adapt, and stay up to date with organizational change, challenges, feedback, best practices, and processes.
  • Participate in curriculum and planning meetings, as needed, presenting relevant assessment data.
  • Serve on other KPSOM workgroups and committees.
  • Minimum three (3) years of experience in education, preferably in medical, health professions, or higher education.
  • Minimum two (2) years of experience in assessment principles/methods and educational measurement techniques including formative and summative assessments, and quantitative and qualitative approaches.
  • Minimum two (2) years of experience in a leadership role with or without direct reports.
  • Bachelor's degree in education related area OR four (4) years of experience in a directly related field.
  • High School Diploma or General Education Development (GED) required.
  • Five (5) years of program assessment and process improvement experience, preferably in medical education, health professions, higher education, or social sciences.
  • Master's degree in Education or related field, preferred.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service