Abstract
Purpose:
The aim of this scoping review was to explore current program evaluation practices across various medical schools.
Methods:
We conducted searches in MEDLINE (Ovid), Embase (Elsevier) and ERIC (ed.gov) for original research and review articles related to medical education evaluation with key words evaluation, program, medical education, pre-registration, framework, curriculum, outcomes, evaluation, quality. We followed Arksey and O’Malley’s (2005) process for scoping reviews.
Results:
Thirty-two articles were included. Studies were primarily concerned with either proving (n = 21) or improving efficacy of their programs (n = 11). No studies aimed at comparing programs. Nine were literature reviews. Others aimed to develop a new evaluation model (n = 7) or apply (n = 12) or validate (n = 4) an existing model (or part thereof). Twenty-two studies explicitly identified an evaluation model they had used or would recommend. Most frequently used models for evaluation were: Context-Input-Process-Product, Kirkpatrick, World Federation Medical Education, and the Standards by Joint Committee on Standards for Educational Evaluation. Overall, evaluations were learner-focused and accreditation driven with a minority considering the broader influences of program success.
Conclusion:
Program evaluation is fundamental to driving the quality of education delivered to produce workforce-ready healthcare professionals. The focus of current evaluations is on student experience and content delivery with a significant gap in the existing literature on evaluation related to staff, learner/staff well-being, equity, diversity, and meta evaluation.
The aim of this scoping review was to explore current program evaluation practices across various medical schools.
Methods:
We conducted searches in MEDLINE (Ovid), Embase (Elsevier) and ERIC (ed.gov) for original research and review articles related to medical education evaluation with key words evaluation, program, medical education, pre-registration, framework, curriculum, outcomes, evaluation, quality. We followed Arksey and O’Malley’s (2005) process for scoping reviews.
Results:
Thirty-two articles were included. Studies were primarily concerned with either proving (n = 21) or improving efficacy of their programs (n = 11). No studies aimed at comparing programs. Nine were literature reviews. Others aimed to develop a new evaluation model (n = 7) or apply (n = 12) or validate (n = 4) an existing model (or part thereof). Twenty-two studies explicitly identified an evaluation model they had used or would recommend. Most frequently used models for evaluation were: Context-Input-Process-Product, Kirkpatrick, World Federation Medical Education, and the Standards by Joint Committee on Standards for Educational Evaluation. Overall, evaluations were learner-focused and accreditation driven with a minority considering the broader influences of program success.
Conclusion:
Program evaluation is fundamental to driving the quality of education delivered to produce workforce-ready healthcare professionals. The focus of current evaluations is on student experience and content delivery with a significant gap in the existing literature on evaluation related to staff, learner/staff well-being, equity, diversity, and meta evaluation.
| Original language | English |
|---|---|
| Pages (from-to) | 1-14 |
| Number of pages | 14 |
| Journal | PLoS ONE |
| Volume | 19 |
| Issue number | 10 |
| DOIs | |
| Publication status | Published - 25 Oct 2024 |
