Educational interventions to improve people's understanding of key concepts in assessing the effects of health interventions: a systematic review

Leila Cusack, Chris B. Del Mar, Iain Chalmers, Elizabeth Gibson, Tammy C. Hoffmann

Research output: Contribution to journalArticleResearchpeer-review

2 Citations (Scopus)
34 Downloads (Pure)

Abstract

Background: Health information is readily accessible but is of variable quality. General knowledge about how to assess whether claims about health interventions are trustworthy is not common, so people's health decisions can be ill-informed, unnecessarily costly and even unsafe. This review aims to identify and evaluate studies of educational interventions designed to improve people's understanding of key concepts for evaluating claims about the effects of health interventions. Methods/Design: We searched multiple electronic databases and sources of grey literature. Inclusion criteria included all study types that included a comparison, any participants (except health professionals or health professional students) and educational interventions aimed at improving people's understanding of one or more of the key concepts considered necessary for assessing health intervention claims. Knowledge and/or understanding of concepts or skills relevant to evaluating health information were our primary outcome measures. Secondary outcomes included behaviour, confidence, attitude and satisfaction with the educational interventions. Two authors independently screened search results, assessed study eligibility and risk of bias and extracted data. Results were summarised using descriptive synthesis. Results: Among 24 eligible studies, 14 were randomised trials and 10 used other study designs. There was heterogeneity across study participants, settings and educational intervention type, content and delivery. The risk of bias was high in at least one domain for all randomised studies. Most studies measured outcomes immediately after the educational intervention, with few measuring later. In most of the comparisons, measures of knowledge and skills were better among those who had received educational interventions than among controls, and some of these differences were statistically significant. The effects on secondary outcomes were inconsistent. Conclusions: Educational interventions to improve people's understanding of key concepts for evaluating health intervention claims can improve people's knowledge and skills, at least in the short term. Effects on confidence, attitude and behaviour are uncertain. Many of the studies were at moderate or greater risk of bias. Improvements in study quality, consistency of outcome measures and measures of longer-term effects are needed to improve confidence in estimates of the effects of educational interventions to improve people's understanding of key concepts for evaluating health intervention claims. Systematic review registration: PROSPERO CRD42016033103

Original languageEnglish
Article number68
JournalSystematic Reviews
Volume7
Issue number1
DOIs
Publication statusPublished - 2 May 2018

Fingerprint

Health
Outcome Assessment (Health Care)
Literature
Databases
Students

Cite this

@article{9c7db700dda649eca31330817be5bf2b,
title = "Educational interventions to improve people's understanding of key concepts in assessing the effects of health interventions: a systematic review",
abstract = "Background: Health information is readily accessible but is of variable quality. General knowledge about how to assess whether claims about health interventions are trustworthy is not common, so people's health decisions can be ill-informed, unnecessarily costly and even unsafe. This review aims to identify and evaluate studies of educational interventions designed to improve people's understanding of key concepts for evaluating claims about the effects of health interventions. Methods/Design: We searched multiple electronic databases and sources of grey literature. Inclusion criteria included all study types that included a comparison, any participants (except health professionals or health professional students) and educational interventions aimed at improving people's understanding of one or more of the key concepts considered necessary for assessing health intervention claims. Knowledge and/or understanding of concepts or skills relevant to evaluating health information were our primary outcome measures. Secondary outcomes included behaviour, confidence, attitude and satisfaction with the educational interventions. Two authors independently screened search results, assessed study eligibility and risk of bias and extracted data. Results were summarised using descriptive synthesis. Results: Among 24 eligible studies, 14 were randomised trials and 10 used other study designs. There was heterogeneity across study participants, settings and educational intervention type, content and delivery. The risk of bias was high in at least one domain for all randomised studies. Most studies measured outcomes immediately after the educational intervention, with few measuring later. In most of the comparisons, measures of knowledge and skills were better among those who had received educational interventions than among controls, and some of these differences were statistically significant. The effects on secondary outcomes were inconsistent. Conclusions: Educational interventions to improve people's understanding of key concepts for evaluating health intervention claims can improve people's knowledge and skills, at least in the short term. Effects on confidence, attitude and behaviour are uncertain. Many of the studies were at moderate or greater risk of bias. Improvements in study quality, consistency of outcome measures and measures of longer-term effects are needed to improve confidence in estimates of the effects of educational interventions to improve people's understanding of key concepts for evaluating health intervention claims. Systematic review registration: PROSPERO CRD42016033103",
author = "Leila Cusack and {Del Mar}, {Chris B.} and Iain Chalmers and Elizabeth Gibson and Hoffmann, {Tammy C.}",
year = "2018",
month = "5",
day = "2",
doi = "10.1186/s13643-018-0719-4",
language = "English",
volume = "7",
journal = "Systematic Reviews",
issn = "2046-4053",
publisher = "BMC",
number = "1",

}

Educational interventions to improve people's understanding of key concepts in assessing the effects of health interventions: a systematic review. / Cusack, Leila; Del Mar, Chris B.; Chalmers, Iain; Gibson, Elizabeth; Hoffmann, Tammy C.

In: Systematic Reviews, Vol. 7, No. 1, 68, 02.05.2018.

Research output: Contribution to journalArticleResearchpeer-review

TY - JOUR

T1 - Educational interventions to improve people's understanding of key concepts in assessing the effects of health interventions: a systematic review

AU - Cusack, Leila

AU - Del Mar, Chris B.

AU - Chalmers, Iain

AU - Gibson, Elizabeth

AU - Hoffmann, Tammy C.

PY - 2018/5/2

Y1 - 2018/5/2

N2 - Background: Health information is readily accessible but is of variable quality. General knowledge about how to assess whether claims about health interventions are trustworthy is not common, so people's health decisions can be ill-informed, unnecessarily costly and even unsafe. This review aims to identify and evaluate studies of educational interventions designed to improve people's understanding of key concepts for evaluating claims about the effects of health interventions. Methods/Design: We searched multiple electronic databases and sources of grey literature. Inclusion criteria included all study types that included a comparison, any participants (except health professionals or health professional students) and educational interventions aimed at improving people's understanding of one or more of the key concepts considered necessary for assessing health intervention claims. Knowledge and/or understanding of concepts or skills relevant to evaluating health information were our primary outcome measures. Secondary outcomes included behaviour, confidence, attitude and satisfaction with the educational interventions. Two authors independently screened search results, assessed study eligibility and risk of bias and extracted data. Results were summarised using descriptive synthesis. Results: Among 24 eligible studies, 14 were randomised trials and 10 used other study designs. There was heterogeneity across study participants, settings and educational intervention type, content and delivery. The risk of bias was high in at least one domain for all randomised studies. Most studies measured outcomes immediately after the educational intervention, with few measuring later. In most of the comparisons, measures of knowledge and skills were better among those who had received educational interventions than among controls, and some of these differences were statistically significant. The effects on secondary outcomes were inconsistent. Conclusions: Educational interventions to improve people's understanding of key concepts for evaluating health intervention claims can improve people's knowledge and skills, at least in the short term. Effects on confidence, attitude and behaviour are uncertain. Many of the studies were at moderate or greater risk of bias. Improvements in study quality, consistency of outcome measures and measures of longer-term effects are needed to improve confidence in estimates of the effects of educational interventions to improve people's understanding of key concepts for evaluating health intervention claims. Systematic review registration: PROSPERO CRD42016033103

AB - Background: Health information is readily accessible but is of variable quality. General knowledge about how to assess whether claims about health interventions are trustworthy is not common, so people's health decisions can be ill-informed, unnecessarily costly and even unsafe. This review aims to identify and evaluate studies of educational interventions designed to improve people's understanding of key concepts for evaluating claims about the effects of health interventions. Methods/Design: We searched multiple electronic databases and sources of grey literature. Inclusion criteria included all study types that included a comparison, any participants (except health professionals or health professional students) and educational interventions aimed at improving people's understanding of one or more of the key concepts considered necessary for assessing health intervention claims. Knowledge and/or understanding of concepts or skills relevant to evaluating health information were our primary outcome measures. Secondary outcomes included behaviour, confidence, attitude and satisfaction with the educational interventions. Two authors independently screened search results, assessed study eligibility and risk of bias and extracted data. Results were summarised using descriptive synthesis. Results: Among 24 eligible studies, 14 were randomised trials and 10 used other study designs. There was heterogeneity across study participants, settings and educational intervention type, content and delivery. The risk of bias was high in at least one domain for all randomised studies. Most studies measured outcomes immediately after the educational intervention, with few measuring later. In most of the comparisons, measures of knowledge and skills were better among those who had received educational interventions than among controls, and some of these differences were statistically significant. The effects on secondary outcomes were inconsistent. Conclusions: Educational interventions to improve people's understanding of key concepts for evaluating health intervention claims can improve people's knowledge and skills, at least in the short term. Effects on confidence, attitude and behaviour are uncertain. Many of the studies were at moderate or greater risk of bias. Improvements in study quality, consistency of outcome measures and measures of longer-term effects are needed to improve confidence in estimates of the effects of educational interventions to improve people's understanding of key concepts for evaluating health intervention claims. Systematic review registration: PROSPERO CRD42016033103

UR - http://www.scopus.com/inward/record.url?scp=85046292653&partnerID=8YFLogxK

U2 - 10.1186/s13643-018-0719-4

DO - 10.1186/s13643-018-0719-4

M3 - Article

VL - 7

JO - Systematic Reviews

JF - Systematic Reviews

SN - 2046-4053

IS - 1

M1 - 68

ER -