Psychometric Analyst

Canadian Alliance of Physiotherapy Regulators•Toronto, ON

About The Position

The Canadian Alliance of Physiotherapy Regulators (CAPR) has an immediate opening for a full-time Psychometric Analyst. Working under the guidance of the Lead Psychometrician, this role is responsible for the data analysis, scoring, and reporting of high-stakes entry-to-practice examinations and credentialing assessments for physiotherapists. CAPR is seeking a candidate with a Master’s degree in a quantitative field, 1–3 years of experience, and strong statistical skills. About CAPR: The Canadian Alliance of Physiotherapy Regulators is a credentialing and assessment agency that provides evaluation services on behalf of the Canadian provincial and territorial physiotherapy regulators (called Colleges). On behalf of the regulators, we review the education and qualifications of applicants educated outside of Canada to determine whether their education is substantially different from those of Canadian-educated physiotherapists. For both Canadian and internationally educated physiotherapists, we administer the entry to practice licensure examination to determine a candidate's readiness for safe, effective, and independent physiotherapy practice. For more information, please visit our website at http://www.alliancept.org Position Summary: The Psychometric Analyst supports the operational delivery of psychometric activities across CAPR’s assessment programs, including the Physiotherapy Evaluation Tool (for internationally educated physiotherapists) and the Canadian Physiotherapy Examination. Working under the guidance of the Lead Psychometrician, this role contributes to data analysis, scoring, and reporting activities, and contributes to maintaining the integrity and defensibility of assessment outcomes.

Requirements

Master’s degree in psychometrics, statistics, quantitative psychology, or a related field (PhD considered an asset).
1–3 years of experience in assessment, data analysis, or a related field
Experience with high-stakes assessment considered an asset.
Experience with statistical analysis using tools such as R, Python, or SPSS.
Working knowledge of psychometric methods, statistical procedures, and research design.
Ability to identify and analyze issues in test development and/or administration and contribute to developing solutions.
Strong attention to detail and commitment to data accuracy and quality.
Strong written and verbal communication skills, with the ability to clearly present technical information to diverse audiences.
Strong interpersonal skills and ability to work collaboratively in a team environment to meet timelines and deliverables.

Nice To Haves

PhD considered an asset.
Experience with high-stakes assessment considered an asset.

Responsibilities

Conduct routine analysis of data from CAPR’s examinations and assessments, including item-level and test-level statistics.
Identify trends, patterns, and anomalies in candidate performance and flag for review.
Support analyses related to credentialling data for internationally educated physiotherapists.
Analyze and summarize post-exam candidate and examiner feedback survey results.
Assist in maintaining and updating standard analysis scripts and processes.
Execute scoring processes for all CAPR assessments.
Support the application of established scoring, standard setting, and equating methods.
Perform quality checks to ensure accuracy and completeness of candidate results.
Participate in verification and validation steps prior to release of results.
Assist in the preparation of post-exam reports for candidates, regulators, and academic stakeholders.
Contribute to the development of annual academic and technical reports.
Support the creation and maintenance of dashboards (e.g., visual reporting tools) and data summaries for internal use.
Translate analytical results into clear, accessible summaries.
Support test assembly processes, including blueprint adherence and item selection.
Assist with standard setting and validation activities by preparing data and materials.
Contribute to item banking processes, including data updates and documentation.
Prepare materials and analyses for internal and external committees (e.g., Exam Validation Committee).
Perform data validation and quality assurance checks on datasets and outputs.
Follow established procedures to ensure consistency and accuracy across psychometric processes.
Document processes and support the maintenance of standard operating procedures.
Escalate data issues or inconsistencies to the Lead Psychometrician, as appropriate.
Work closely with examination and credentialling teams to support assessment delivery.
Communicate findings and updates clearly to both technical and non-technical audiences.
Contribute to a collaborative team environment and support shared timelines and deliverables.

Benefits

$70,000 - $90,000 depending on experience
Comprehensive health and dental benefits, including vision, life insurance, and critical illness
Long-term and short-term disability coverage
Health Care Spending Account
Employer RRSP matching
3 weeks paid vacation

Stand Out From the Crowd

Upload your resume and get instant feedback on how well it matches this job.

Upload and Match Resume