Systematic review automation technologies

Guy Tsafnat, Paul Glasziou, Miew K. Choong, Adam Dunn, Filippo Galgani, Enrico Coiera

Research output: Contribution to journalComment/debateResearchpeer-review

93 Citations (Scopus)
54 Downloads (Pure)

Abstract

Systematic reviews, a cornerstone of evidence-based medicine, are not produced quickly enough to support clinical practice. The cost of production, availability of the requisite expertise and timeliness are often quoted as major contributors for the delay. This detailed survey of the state of the art of information systems designed to support or automate individual tasks in the systematic review, and in particular systematic reviews of randomized controlled clinical trials, reveals trends that see the convergence of several parallel research projects. We surveyed literature describing informatics systems that support or automate the processes of systematic review or each of the tasks of the systematic review. Several projects focus on automating, simplifying and/or streamlining specific tasks of the systematic review. Some tasks are already fully automated while others are still largely manual. In this review, we describe each task and the effect that its automation would have on the entire systematic review process, summarize the existing information system support for each task, and highlight where further research is needed for realizing automation for the task. Integration of the systems that automate systematic review tasks may lead to a revised systematic review workflow. We envisage the optimized workflow will lead to system in which each systematic review is described as a computer program that automatically retrieves relevant trials, appraises them, extracts and synthesizes data, evaluates the risk of bias, performs meta-analysis calculations, and produces a report in real time.

Original languageEnglish
Article number74
JournalSystematic Reviews
Volume3
Issue number1
DOIs
Publication statusPublished - 12 Apr 2014

Fingerprint

Workflow
Automation
Information Systems
Systems Integration
Technology
Informatics
Evidence-Based Medicine
Research
Meta-Analysis
Software
Randomized Controlled Trials
Costs and Cost Analysis
Surveys and Questionnaires

Cite this

Tsafnat, G., Glasziou, P., Choong, M. K., Dunn, A., Galgani, F., & Coiera, E. (2014). Systematic review automation technologies. Systematic Reviews, 3(1), [74]. https://doi.org/10.1186/2046-4053-3-74
Tsafnat, Guy ; Glasziou, Paul ; Choong, Miew K. ; Dunn, Adam ; Galgani, Filippo ; Coiera, Enrico. / Systematic review automation technologies. In: Systematic Reviews. 2014 ; Vol. 3, No. 1.
@article{a8153d2b65ed4f3e906fe6dcefe3294f,
title = "Systematic review automation technologies",
abstract = "Systematic reviews, a cornerstone of evidence-based medicine, are not produced quickly enough to support clinical practice. The cost of production, availability of the requisite expertise and timeliness are often quoted as major contributors for the delay. This detailed survey of the state of the art of information systems designed to support or automate individual tasks in the systematic review, and in particular systematic reviews of randomized controlled clinical trials, reveals trends that see the convergence of several parallel research projects. We surveyed literature describing informatics systems that support or automate the processes of systematic review or each of the tasks of the systematic review. Several projects focus on automating, simplifying and/or streamlining specific tasks of the systematic review. Some tasks are already fully automated while others are still largely manual. In this review, we describe each task and the effect that its automation would have on the entire systematic review process, summarize the existing information system support for each task, and highlight where further research is needed for realizing automation for the task. Integration of the systems that automate systematic review tasks may lead to a revised systematic review workflow. We envisage the optimized workflow will lead to system in which each systematic review is described as a computer program that automatically retrieves relevant trials, appraises them, extracts and synthesizes data, evaluates the risk of bias, performs meta-analysis calculations, and produces a report in real time.",
author = "Guy Tsafnat and Paul Glasziou and Choong, {Miew K.} and Adam Dunn and Filippo Galgani and Enrico Coiera",
year = "2014",
month = "4",
day = "12",
doi = "10.1186/2046-4053-3-74",
language = "English",
volume = "3",
journal = "Systematic Reviews",
issn = "2046-4053",
publisher = "BMC",
number = "1",

}

Tsafnat, G, Glasziou, P, Choong, MK, Dunn, A, Galgani, F & Coiera, E 2014, 'Systematic review automation technologies' Systematic Reviews, vol. 3, no. 1, 74. https://doi.org/10.1186/2046-4053-3-74

Systematic review automation technologies. / Tsafnat, Guy; Glasziou, Paul; Choong, Miew K.; Dunn, Adam; Galgani, Filippo; Coiera, Enrico.

In: Systematic Reviews, Vol. 3, No. 1, 74, 12.04.2014.

Research output: Contribution to journalComment/debateResearchpeer-review

TY - JOUR

T1 - Systematic review automation technologies

AU - Tsafnat, Guy

AU - Glasziou, Paul

AU - Choong, Miew K.

AU - Dunn, Adam

AU - Galgani, Filippo

AU - Coiera, Enrico

PY - 2014/4/12

Y1 - 2014/4/12

N2 - Systematic reviews, a cornerstone of evidence-based medicine, are not produced quickly enough to support clinical practice. The cost of production, availability of the requisite expertise and timeliness are often quoted as major contributors for the delay. This detailed survey of the state of the art of information systems designed to support or automate individual tasks in the systematic review, and in particular systematic reviews of randomized controlled clinical trials, reveals trends that see the convergence of several parallel research projects. We surveyed literature describing informatics systems that support or automate the processes of systematic review or each of the tasks of the systematic review. Several projects focus on automating, simplifying and/or streamlining specific tasks of the systematic review. Some tasks are already fully automated while others are still largely manual. In this review, we describe each task and the effect that its automation would have on the entire systematic review process, summarize the existing information system support for each task, and highlight where further research is needed for realizing automation for the task. Integration of the systems that automate systematic review tasks may lead to a revised systematic review workflow. We envisage the optimized workflow will lead to system in which each systematic review is described as a computer program that automatically retrieves relevant trials, appraises them, extracts and synthesizes data, evaluates the risk of bias, performs meta-analysis calculations, and produces a report in real time.

AB - Systematic reviews, a cornerstone of evidence-based medicine, are not produced quickly enough to support clinical practice. The cost of production, availability of the requisite expertise and timeliness are often quoted as major contributors for the delay. This detailed survey of the state of the art of information systems designed to support or automate individual tasks in the systematic review, and in particular systematic reviews of randomized controlled clinical trials, reveals trends that see the convergence of several parallel research projects. We surveyed literature describing informatics systems that support or automate the processes of systematic review or each of the tasks of the systematic review. Several projects focus on automating, simplifying and/or streamlining specific tasks of the systematic review. Some tasks are already fully automated while others are still largely manual. In this review, we describe each task and the effect that its automation would have on the entire systematic review process, summarize the existing information system support for each task, and highlight where further research is needed for realizing automation for the task. Integration of the systems that automate systematic review tasks may lead to a revised systematic review workflow. We envisage the optimized workflow will lead to system in which each systematic review is described as a computer program that automatically retrieves relevant trials, appraises them, extracts and synthesizes data, evaluates the risk of bias, performs meta-analysis calculations, and produces a report in real time.

UR - http://www.scopus.com/inward/record.url?scp=84910133822&partnerID=8YFLogxK

U2 - 10.1186/2046-4053-3-74

DO - 10.1186/2046-4053-3-74

M3 - Comment/debate

VL - 3

JO - Systematic Reviews

JF - Systematic Reviews

SN - 2046-4053

IS - 1

M1 - 74

ER -

Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E. Systematic review automation technologies. Systematic Reviews. 2014 Apr 12;3(1). 74. https://doi.org/10.1186/2046-4053-3-74