Evaluation and Measurement Analyst

KPMG•Edmonton, AB

About The Position

The Training Evaluation & Measurement Analyst is responsible for assessing the effectiveness and impact of learning programs by supporting the design of measurement strategies, analyzing training data, and providing actionable insights to improve learning outcomes and business performance. This role works closely with course owners, SMEs, and stakeholders to ensure training delivers measurable value. Data Collection & Analysis Collect and validate data from multiple sources (e.g., LMS, surveys, assessments) Analyze quantitative and qualitative data to identify trends, gaps, and improvement opportunities Perform statistical analysis (e.g., pass rates, item difficulty, distractor analysis) to assess assessment quality Reporting & Insights Review dashboards and reports to communicate training performance and outcomes Translate data into clear, actionable insights for course owners and stakeholders Provide recommendations for course improvements based on findings Continuous Improvement Monitor training effectiveness throughout the lifecycle (pre-, during, and post-delivery) Partner with SMEs and course owners to refine content, assessments, and delivery methods Support post-course evaluations and follow-up analysis (e.g., behavior and performance impact)

Requirements

3 years experience in learning analytics, training evaluation, data analysis, research, or a related field.
Strong analytical and problem-solving skills, with the ability to identify trends, interpret data, and make practical recommendations.
Experience working with data visualization and reporting tools such as Excel, Power BI, Tableau, or similar platforms.
Strong attention to detail and commitment to data accuracy and quality.
Excellent verbal and written communication skills, with the ability to present findings to both technical and non-technical audiences.
Ability to manage multiple priorities and work effectively in a fast-paced, collaborative environment.
Strong stakeholder management and relationship-building skills, with the ability to work across teams and influence decision-making through data-driven insights.
A continuous improvement mindset and a passion for enhancing learning outcomes through measurement and evaluation.

Nice To Haves

Knowledge of learning measurement and evaluation methodologies, such as the Kirkpatrick Model or other evaluation frameworks, is an asset.
Experience working with Learning Management Systems (LMS) and learning technologies is considered an asset.

Responsibilities

Collect, validate, and analyze data from multiple sources, including learning management systems, surveys and assessments.
Identify trends, patterns, learning gaps, and opportunities for improvement through quantitative and qualitative analysis.
Conduct measurement and evaluation activities, including assessment analysis, learner feedback reviews, pass rate analysis, item difficulty reviews, and other evaluation methodologies.
Maintain reporting dashboards and metrics to monitor learning effectiveness and learner performance.
Translate complex data into clear, actionable insights and recommendations for stakeholders and course owners.
Support the evaluation of learning initiatives throughout the training lifecycle, from pre-deployment through post-course analysis.
Collaborate with course owners and SMEs to identify opportunities to improve course content, assessments, learner engagement, and overall learning impact.
Contribute to the development and continuous improvement of evaluation frameworks, measurement strategies, and reporting standards.
Support the preparation and presentation of findings, recommendations, and evaluation results to various stakeholders.
Assist with special projects and initiatives related to learning analytics, measurement, and continuous improvement.