Measuring assessors' experiences of grading marginal student performances in clinical assessments - The assess-safe tool

Development and preliminary psychometric validation

Lynda J Hughes, Marion L Mitchell, Cindy Jones, Amy N B Johnston

Research output: Contribution to journalArticleResearchpeer-review

Abstract

Assessment of fitness for practice in the nursing student population is an essential yet challenging component of nursing education. The aim of this research was to describe the development and preliminary validation of the Assess-Safe instrument that explores assessors' experiences of grading nursing student performances in clinical courses when that performance is not a clear pass or fail. A 3 phase approach was used to develop and psychometrically test the instrument. Phase 1 involved the development of a pool of items following a literature review, coupled with findings from qualitative data. In phase 2, an expert panel rated the items for clarity and relevance, reducing the item pool. Assessors of Australian undergraduate nursing students from industry and academia were recruited for this study. A sample of 149 assessors across industry and academia completed the resultant survey to pilot test the instrument; constituting Phase 3. A high content validity index score of 0.95 was achieved through expert review. Construct validity using factor analysis revealed four factors including: assessor support; process support; assessor introspection; and student support. The Assess-Safe instrument achieved good internal reliability with an overall Cronbach's alpha coefficient of 0.77; and sub-scale scores ranging from 0.71 to 0.79. The Assess-Safe instrument demonstrated satisfactory psychometric properties and has utility for education programmes, research and policy development across a variety of practice based professions. Nonetheless, further psychometric validation is warranted.

Original languageEnglish
Article number102701
Number of pages8
JournalNurse Education in Practice
Volume43
Early online date20 Jan 2020
DOIs
Publication statusPublished - Feb 2020

Fingerprint

Nursing Students
grading
Psychometrics
psychometrics
Students
nursing
Industry
performance
experience
Program Development
student
Nursing Education
Policy Making
Research
Statistical Factor Analysis
expert
introspection
industry
Education
construct validity

Cite this

@article{548633d1f11a419eb2dda1b9d85e1776,
title = "Measuring assessors' experiences of grading marginal student performances in clinical assessments - The assess-safe tool: Development and preliminary psychometric validation",
abstract = "Assessment of fitness for practice in the nursing student population is an essential yet challenging component of nursing education. The aim of this research was to describe the development and preliminary validation of the Assess-Safe instrument that explores assessors' experiences of grading nursing student performances in clinical courses when that performance is not a clear pass or fail. A 3 phase approach was used to develop and psychometrically test the instrument. Phase 1 involved the development of a pool of items following a literature review, coupled with findings from qualitative data. In phase 2, an expert panel rated the items for clarity and relevance, reducing the item pool. Assessors of Australian undergraduate nursing students from industry and academia were recruited for this study. A sample of 149 assessors across industry and academia completed the resultant survey to pilot test the instrument; constituting Phase 3. A high content validity index score of 0.95 was achieved through expert review. Construct validity using factor analysis revealed four factors including: assessor support; process support; assessor introspection; and student support. The Assess-Safe instrument achieved good internal reliability with an overall Cronbach's alpha coefficient of 0.77; and sub-scale scores ranging from 0.71 to 0.79. The Assess-Safe instrument demonstrated satisfactory psychometric properties and has utility for education programmes, research and policy development across a variety of practice based professions. Nonetheless, further psychometric validation is warranted.",
author = "Hughes, {Lynda J} and Mitchell, {Marion L} and Cindy Jones and Johnston, {Amy N B}",
note = "Copyright {\circledC} 2020. Published by Elsevier Ltd.",
year = "2020",
month = "2",
doi = "10.1016/j.nepr.2020.102701",
language = "English",
volume = "43",
journal = "Nurse Education in Practice",
issn = "1471-5953",
publisher = "Churchill Livingstone",

}

Measuring assessors' experiences of grading marginal student performances in clinical assessments - The assess-safe tool : Development and preliminary psychometric validation. / Hughes, Lynda J; Mitchell, Marion L; Jones, Cindy; Johnston, Amy N B.

In: Nurse Education in Practice, Vol. 43, 102701, 02.2020.

Research output: Contribution to journalArticleResearchpeer-review

TY - JOUR

T1 - Measuring assessors' experiences of grading marginal student performances in clinical assessments - The assess-safe tool

T2 - Development and preliminary psychometric validation

AU - Hughes, Lynda J

AU - Mitchell, Marion L

AU - Jones, Cindy

AU - Johnston, Amy N B

N1 - Copyright © 2020. Published by Elsevier Ltd.

PY - 2020/2

Y1 - 2020/2

N2 - Assessment of fitness for practice in the nursing student population is an essential yet challenging component of nursing education. The aim of this research was to describe the development and preliminary validation of the Assess-Safe instrument that explores assessors' experiences of grading nursing student performances in clinical courses when that performance is not a clear pass or fail. A 3 phase approach was used to develop and psychometrically test the instrument. Phase 1 involved the development of a pool of items following a literature review, coupled with findings from qualitative data. In phase 2, an expert panel rated the items for clarity and relevance, reducing the item pool. Assessors of Australian undergraduate nursing students from industry and academia were recruited for this study. A sample of 149 assessors across industry and academia completed the resultant survey to pilot test the instrument; constituting Phase 3. A high content validity index score of 0.95 was achieved through expert review. Construct validity using factor analysis revealed four factors including: assessor support; process support; assessor introspection; and student support. The Assess-Safe instrument achieved good internal reliability with an overall Cronbach's alpha coefficient of 0.77; and sub-scale scores ranging from 0.71 to 0.79. The Assess-Safe instrument demonstrated satisfactory psychometric properties and has utility for education programmes, research and policy development across a variety of practice based professions. Nonetheless, further psychometric validation is warranted.

AB - Assessment of fitness for practice in the nursing student population is an essential yet challenging component of nursing education. The aim of this research was to describe the development and preliminary validation of the Assess-Safe instrument that explores assessors' experiences of grading nursing student performances in clinical courses when that performance is not a clear pass or fail. A 3 phase approach was used to develop and psychometrically test the instrument. Phase 1 involved the development of a pool of items following a literature review, coupled with findings from qualitative data. In phase 2, an expert panel rated the items for clarity and relevance, reducing the item pool. Assessors of Australian undergraduate nursing students from industry and academia were recruited for this study. A sample of 149 assessors across industry and academia completed the resultant survey to pilot test the instrument; constituting Phase 3. A high content validity index score of 0.95 was achieved through expert review. Construct validity using factor analysis revealed four factors including: assessor support; process support; assessor introspection; and student support. The Assess-Safe instrument achieved good internal reliability with an overall Cronbach's alpha coefficient of 0.77; and sub-scale scores ranging from 0.71 to 0.79. The Assess-Safe instrument demonstrated satisfactory psychometric properties and has utility for education programmes, research and policy development across a variety of practice based professions. Nonetheless, further psychometric validation is warranted.

U2 - 10.1016/j.nepr.2020.102701

DO - 10.1016/j.nepr.2020.102701

M3 - Article

VL - 43

JO - Nurse Education in Practice

JF - Nurse Education in Practice

SN - 1471-5953

M1 - 102701

ER -