Design and validation of the Regional Anaesthesia Procedural Skills Assessment Tool

A. Chuan, P. L. Graham, D. M. Wong, M. J. Barrington, D. B. Auyong, A. J D Cameron, Y. C. Lim, L. Pope, B. Germanoska, K. Forrest, C. F. Royse

Research output: Contribution to journalArticleResearchpeer-review

14 Citations (Scopus)

Abstract

The aim of this study was to create and evaluate the validity, reliability and feasibility of the Regional Anaesthesia Procedural Skills tool, designed for the assessment of all peripheral and neuraxial blocks using all nerve localisation techniques. The first phase was construction of a 25-item checklist by five regional anaesthesia experts using a Delphi process. This checklist was combined with a global rating scale to create the tool. In the second phase, initial validation by 10 independent anaesthetists using a test-retest methodology was successful (Cohen kappa ≥ 0.70 for inter-rater agreement, scores between test to retest, paired t-test, p > 0.12). In the third phase, 70 clinical videos of trainees were scored by three blinded international assessors. The RAPS tool exhibited face validity (p < 0.026), construct validity (p < 0.001), feasibility (mean time to score < 3.9 min), and overall reliability (intraclass correlation coefficient 0.80 (95% CI 0.67-0.88)). The Regional Anaesthesia Procedural Skills tool used in this study is a valid and reliable assessment tool to score the performance of trainees for regional anaesthesia.

Original languageEnglish
Pages (from-to)1401-1411
Number of pages11
JournalAnaesthesia
Volume70
Issue number12
DOIs
Publication statusPublished - 1 Dec 2015
Externally publishedYes

Fingerprint

Conduction Anesthesia
Checklist
Reproducibility of Results

Cite this

Chuan, A., Graham, P. L., Wong, D. M., Barrington, M. J., Auyong, D. B., Cameron, A. J. D., ... Royse, C. F. (2015). Design and validation of the Regional Anaesthesia Procedural Skills Assessment Tool. Anaesthesia, 70(12), 1401-1411. https://doi.org/10.1111/anae.13266
Chuan, A. ; Graham, P. L. ; Wong, D. M. ; Barrington, M. J. ; Auyong, D. B. ; Cameron, A. J D ; Lim, Y. C. ; Pope, L. ; Germanoska, B. ; Forrest, K. ; Royse, C. F. / Design and validation of the Regional Anaesthesia Procedural Skills Assessment Tool. In: Anaesthesia. 2015 ; Vol. 70, No. 12. pp. 1401-1411.
@article{60bf20d74c4440e19024cd90a2d2f5a0,
title = "Design and validation of the Regional Anaesthesia Procedural Skills Assessment Tool",
abstract = "The aim of this study was to create and evaluate the validity, reliability and feasibility of the Regional Anaesthesia Procedural Skills tool, designed for the assessment of all peripheral and neuraxial blocks using all nerve localisation techniques. The first phase was construction of a 25-item checklist by five regional anaesthesia experts using a Delphi process. This checklist was combined with a global rating scale to create the tool. In the second phase, initial validation by 10 independent anaesthetists using a test-retest methodology was successful (Cohen kappa ≥ 0.70 for inter-rater agreement, scores between test to retest, paired t-test, p > 0.12). In the third phase, 70 clinical videos of trainees were scored by three blinded international assessors. The RAPS tool exhibited face validity (p < 0.026), construct validity (p < 0.001), feasibility (mean time to score < 3.9 min), and overall reliability (intraclass correlation coefficient 0.80 (95{\%} CI 0.67-0.88)). The Regional Anaesthesia Procedural Skills tool used in this study is a valid and reliable assessment tool to score the performance of trainees for regional anaesthesia.",
author = "A. Chuan and Graham, {P. L.} and Wong, {D. M.} and Barrington, {M. J.} and Auyong, {D. B.} and Cameron, {A. J D} and Lim, {Y. C.} and L. Pope and B. Germanoska and K. Forrest and Royse, {C. F.}",
year = "2015",
month = "12",
day = "1",
doi = "10.1111/anae.13266",
language = "English",
volume = "70",
pages = "1401--1411",
journal = "Anaesthesia",
issn = "0003-2409",
publisher = "Wiley-Blackwell",
number = "12",

}

Chuan, A, Graham, PL, Wong, DM, Barrington, MJ, Auyong, DB, Cameron, AJD, Lim, YC, Pope, L, Germanoska, B, Forrest, K & Royse, CF 2015, 'Design and validation of the Regional Anaesthesia Procedural Skills Assessment Tool' Anaesthesia, vol. 70, no. 12, pp. 1401-1411. https://doi.org/10.1111/anae.13266

Design and validation of the Regional Anaesthesia Procedural Skills Assessment Tool. / Chuan, A.; Graham, P. L.; Wong, D. M.; Barrington, M. J.; Auyong, D. B.; Cameron, A. J D; Lim, Y. C.; Pope, L.; Germanoska, B.; Forrest, K.; Royse, C. F.

In: Anaesthesia, Vol. 70, No. 12, 01.12.2015, p. 1401-1411.

Research output: Contribution to journalArticleResearchpeer-review

TY - JOUR

T1 - Design and validation of the Regional Anaesthesia Procedural Skills Assessment Tool

AU - Chuan, A.

AU - Graham, P. L.

AU - Wong, D. M.

AU - Barrington, M. J.

AU - Auyong, D. B.

AU - Cameron, A. J D

AU - Lim, Y. C.

AU - Pope, L.

AU - Germanoska, B.

AU - Forrest, K.

AU - Royse, C. F.

PY - 2015/12/1

Y1 - 2015/12/1

N2 - The aim of this study was to create and evaluate the validity, reliability and feasibility of the Regional Anaesthesia Procedural Skills tool, designed for the assessment of all peripheral and neuraxial blocks using all nerve localisation techniques. The first phase was construction of a 25-item checklist by five regional anaesthesia experts using a Delphi process. This checklist was combined with a global rating scale to create the tool. In the second phase, initial validation by 10 independent anaesthetists using a test-retest methodology was successful (Cohen kappa ≥ 0.70 for inter-rater agreement, scores between test to retest, paired t-test, p > 0.12). In the third phase, 70 clinical videos of trainees were scored by three blinded international assessors. The RAPS tool exhibited face validity (p < 0.026), construct validity (p < 0.001), feasibility (mean time to score < 3.9 min), and overall reliability (intraclass correlation coefficient 0.80 (95% CI 0.67-0.88)). The Regional Anaesthesia Procedural Skills tool used in this study is a valid and reliable assessment tool to score the performance of trainees for regional anaesthesia.

AB - The aim of this study was to create and evaluate the validity, reliability and feasibility of the Regional Anaesthesia Procedural Skills tool, designed for the assessment of all peripheral and neuraxial blocks using all nerve localisation techniques. The first phase was construction of a 25-item checklist by five regional anaesthesia experts using a Delphi process. This checklist was combined with a global rating scale to create the tool. In the second phase, initial validation by 10 independent anaesthetists using a test-retest methodology was successful (Cohen kappa ≥ 0.70 for inter-rater agreement, scores between test to retest, paired t-test, p > 0.12). In the third phase, 70 clinical videos of trainees were scored by three blinded international assessors. The RAPS tool exhibited face validity (p < 0.026), construct validity (p < 0.001), feasibility (mean time to score < 3.9 min), and overall reliability (intraclass correlation coefficient 0.80 (95% CI 0.67-0.88)). The Regional Anaesthesia Procedural Skills tool used in this study is a valid and reliable assessment tool to score the performance of trainees for regional anaesthesia.

UR - http://www.scopus.com/inward/record.url?scp=84946842875&partnerID=8YFLogxK

U2 - 10.1111/anae.13266

DO - 10.1111/anae.13266

M3 - Article

VL - 70

SP - 1401

EP - 1411

JO - Anaesthesia

JF - Anaesthesia

SN - 0003-2409

IS - 12

ER -

Chuan A, Graham PL, Wong DM, Barrington MJ, Auyong DB, Cameron AJD et al. Design and validation of the Regional Anaesthesia Procedural Skills Assessment Tool. Anaesthesia. 2015 Dec 1;70(12):1401-1411. https://doi.org/10.1111/anae.13266