On-call competence: Developing a tool for self-assessment

Sandy Thomas, Suzanne Gough, Mary Ann Broad, Jane Cross, Beverley Harden, Paul Ritson, Matthew Quint

Research output: Contribution to journalArticleResearchpeer-review

2 Citations (Scopus)

Abstract

Objective: To develop and validate a self-evaluation tool (questionnaire) to identify perceived competence and confidence felt by physiotherapists undertaking respiratory on-call duty. Design: A questionnaire to rate specific acute care respiratory competencies was developed from criteria in the Emergency Duty Guidelines. A triangulation approach was used to evaluate content validity. The questionnaire was completed by a group of respiratory physiotherapists and a group of non-respiratory physiotherapists. Feedback from respiratory physiotherapists was through open (written) questions, and 15 participated in semi-structured telephone interviews. Participants: A total of 263 participants: a purposive sample of 180 respiratory physiotherapists attending 'On course for on-call' courses in Autumn 2005, and a convenience sample of 83 non-respiratory physiotherapists attending on-call training courses or the 2005 Congress of the Chartered Society of Physiotherapy. Results: Thirty-eight questionnaire items were compiled and tested (12 assessment and 10 treatment competencies, 10 range and six confidence items). There were 222 responses (86% overall response rate). Cronbach's alpha found internal consistency for all items (α > 0.9). There was a significant difference in competence scores between the respiratory group (median 118, interquartile range 111 to 121) and the non-respiratory group (median 76, interquartile range 64 to 87) (P < 0.001). Participants endorsed the content validity of competencies. The importance of current, regular clinical experience in determining competence was highlighted. Self-concept, self-efficacy and attitude to on-call may affect competence rating, and reliance on self-evaluation alone in the assessment of clinical competence was questioned. Conclusions: Respiratory physiotherapists involved in on-call training supported the development of a tool to assess self-perceived competence, and endorsed the content validity of the questionnaire items. The study findings support the validity of the tool as a competency measure since it is able to discriminate between those at different levels of seniority and experience. Participants varied in their approach to rating their own competence in unfamiliar situations; this seemed to depend on self-concept and self-efficacy. Since this tool is based on core respiratory competencies, it may also be used as supportive continuous professional development evidence for the Knowledge and Skills Framework and professional development portfolios. It also has the potential adaptation for use with physiotherapy students and those working in acute respiratory care.

Original languageEnglish
Pages (from-to)204-211
Number of pages8
JournalPhysiotherapy
Volume94
Issue number3
DOIs
Publication statusPublished - 1 Sep 2008
Externally publishedYes

Fingerprint

Physical Therapists
Mental Competency
Diagnostic Self Evaluation
Self Efficacy
Self Concept
Clinical Competence
Self-Assessment
Emergencies
Surveys and Questionnaires
Guidelines
Interviews
Students

Cite this

Thomas, S., Gough, S., Broad, M. A., Cross, J., Harden, B., Ritson, P., & Quint, M. (2008). On-call competence: Developing a tool for self-assessment. Physiotherapy, 94(3), 204-211. https://doi.org/10.1016/j.physio.2008.02.006
Thomas, Sandy ; Gough, Suzanne ; Broad, Mary Ann ; Cross, Jane ; Harden, Beverley ; Ritson, Paul ; Quint, Matthew. / On-call competence : Developing a tool for self-assessment. In: Physiotherapy. 2008 ; Vol. 94, No. 3. pp. 204-211.
@article{a2f01f8906db45d0b301665021ff9bb0,
title = "On-call competence: Developing a tool for self-assessment",
abstract = "Objective: To develop and validate a self-evaluation tool (questionnaire) to identify perceived competence and confidence felt by physiotherapists undertaking respiratory on-call duty. Design: A questionnaire to rate specific acute care respiratory competencies was developed from criteria in the Emergency Duty Guidelines. A triangulation approach was used to evaluate content validity. The questionnaire was completed by a group of respiratory physiotherapists and a group of non-respiratory physiotherapists. Feedback from respiratory physiotherapists was through open (written) questions, and 15 participated in semi-structured telephone interviews. Participants: A total of 263 participants: a purposive sample of 180 respiratory physiotherapists attending 'On course for on-call' courses in Autumn 2005, and a convenience sample of 83 non-respiratory physiotherapists attending on-call training courses or the 2005 Congress of the Chartered Society of Physiotherapy. Results: Thirty-eight questionnaire items were compiled and tested (12 assessment and 10 treatment competencies, 10 range and six confidence items). There were 222 responses (86{\%} overall response rate). Cronbach's alpha found internal consistency for all items (α > 0.9). There was a significant difference in competence scores between the respiratory group (median 118, interquartile range 111 to 121) and the non-respiratory group (median 76, interquartile range 64 to 87) (P < 0.001). Participants endorsed the content validity of competencies. The importance of current, regular clinical experience in determining competence was highlighted. Self-concept, self-efficacy and attitude to on-call may affect competence rating, and reliance on self-evaluation alone in the assessment of clinical competence was questioned. Conclusions: Respiratory physiotherapists involved in on-call training supported the development of a tool to assess self-perceived competence, and endorsed the content validity of the questionnaire items. The study findings support the validity of the tool as a competency measure since it is able to discriminate between those at different levels of seniority and experience. Participants varied in their approach to rating their own competence in unfamiliar situations; this seemed to depend on self-concept and self-efficacy. Since this tool is based on core respiratory competencies, it may also be used as supportive continuous professional development evidence for the Knowledge and Skills Framework and professional development portfolios. It also has the potential adaptation for use with physiotherapy students and those working in acute respiratory care.",
author = "Sandy Thomas and Suzanne Gough and Broad, {Mary Ann} and Jane Cross and Beverley Harden and Paul Ritson and Matthew Quint",
year = "2008",
month = "9",
day = "1",
doi = "10.1016/j.physio.2008.02.006",
language = "English",
volume = "94",
pages = "204--211",
journal = "Physiotherapy",
issn = "0031-9406",
publisher = "Elsevier",
number = "3",

}

Thomas, S, Gough, S, Broad, MA, Cross, J, Harden, B, Ritson, P & Quint, M 2008, 'On-call competence: Developing a tool for self-assessment' Physiotherapy, vol. 94, no. 3, pp. 204-211. https://doi.org/10.1016/j.physio.2008.02.006

On-call competence : Developing a tool for self-assessment. / Thomas, Sandy; Gough, Suzanne; Broad, Mary Ann; Cross, Jane; Harden, Beverley; Ritson, Paul; Quint, Matthew.

In: Physiotherapy, Vol. 94, No. 3, 01.09.2008, p. 204-211.

Research output: Contribution to journalArticleResearchpeer-review

TY - JOUR

T1 - On-call competence

T2 - Developing a tool for self-assessment

AU - Thomas, Sandy

AU - Gough, Suzanne

AU - Broad, Mary Ann

AU - Cross, Jane

AU - Harden, Beverley

AU - Ritson, Paul

AU - Quint, Matthew

PY - 2008/9/1

Y1 - 2008/9/1

N2 - Objective: To develop and validate a self-evaluation tool (questionnaire) to identify perceived competence and confidence felt by physiotherapists undertaking respiratory on-call duty. Design: A questionnaire to rate specific acute care respiratory competencies was developed from criteria in the Emergency Duty Guidelines. A triangulation approach was used to evaluate content validity. The questionnaire was completed by a group of respiratory physiotherapists and a group of non-respiratory physiotherapists. Feedback from respiratory physiotherapists was through open (written) questions, and 15 participated in semi-structured telephone interviews. Participants: A total of 263 participants: a purposive sample of 180 respiratory physiotherapists attending 'On course for on-call' courses in Autumn 2005, and a convenience sample of 83 non-respiratory physiotherapists attending on-call training courses or the 2005 Congress of the Chartered Society of Physiotherapy. Results: Thirty-eight questionnaire items were compiled and tested (12 assessment and 10 treatment competencies, 10 range and six confidence items). There were 222 responses (86% overall response rate). Cronbach's alpha found internal consistency for all items (α > 0.9). There was a significant difference in competence scores between the respiratory group (median 118, interquartile range 111 to 121) and the non-respiratory group (median 76, interquartile range 64 to 87) (P < 0.001). Participants endorsed the content validity of competencies. The importance of current, regular clinical experience in determining competence was highlighted. Self-concept, self-efficacy and attitude to on-call may affect competence rating, and reliance on self-evaluation alone in the assessment of clinical competence was questioned. Conclusions: Respiratory physiotherapists involved in on-call training supported the development of a tool to assess self-perceived competence, and endorsed the content validity of the questionnaire items. The study findings support the validity of the tool as a competency measure since it is able to discriminate between those at different levels of seniority and experience. Participants varied in their approach to rating their own competence in unfamiliar situations; this seemed to depend on self-concept and self-efficacy. Since this tool is based on core respiratory competencies, it may also be used as supportive continuous professional development evidence for the Knowledge and Skills Framework and professional development portfolios. It also has the potential adaptation for use with physiotherapy students and those working in acute respiratory care.

AB - Objective: To develop and validate a self-evaluation tool (questionnaire) to identify perceived competence and confidence felt by physiotherapists undertaking respiratory on-call duty. Design: A questionnaire to rate specific acute care respiratory competencies was developed from criteria in the Emergency Duty Guidelines. A triangulation approach was used to evaluate content validity. The questionnaire was completed by a group of respiratory physiotherapists and a group of non-respiratory physiotherapists. Feedback from respiratory physiotherapists was through open (written) questions, and 15 participated in semi-structured telephone interviews. Participants: A total of 263 participants: a purposive sample of 180 respiratory physiotherapists attending 'On course for on-call' courses in Autumn 2005, and a convenience sample of 83 non-respiratory physiotherapists attending on-call training courses or the 2005 Congress of the Chartered Society of Physiotherapy. Results: Thirty-eight questionnaire items were compiled and tested (12 assessment and 10 treatment competencies, 10 range and six confidence items). There were 222 responses (86% overall response rate). Cronbach's alpha found internal consistency for all items (α > 0.9). There was a significant difference in competence scores between the respiratory group (median 118, interquartile range 111 to 121) and the non-respiratory group (median 76, interquartile range 64 to 87) (P < 0.001). Participants endorsed the content validity of competencies. The importance of current, regular clinical experience in determining competence was highlighted. Self-concept, self-efficacy and attitude to on-call may affect competence rating, and reliance on self-evaluation alone in the assessment of clinical competence was questioned. Conclusions: Respiratory physiotherapists involved in on-call training supported the development of a tool to assess self-perceived competence, and endorsed the content validity of the questionnaire items. The study findings support the validity of the tool as a competency measure since it is able to discriminate between those at different levels of seniority and experience. Participants varied in their approach to rating their own competence in unfamiliar situations; this seemed to depend on self-concept and self-efficacy. Since this tool is based on core respiratory competencies, it may also be used as supportive continuous professional development evidence for the Knowledge and Skills Framework and professional development portfolios. It also has the potential adaptation for use with physiotherapy students and those working in acute respiratory care.

UR - http://www.scopus.com/inward/record.url?scp=68949149160&partnerID=8YFLogxK

U2 - 10.1016/j.physio.2008.02.006

DO - 10.1016/j.physio.2008.02.006

M3 - Article

VL - 94

SP - 204

EP - 211

JO - Physiotherapy

JF - Physiotherapy

SN - 0031-9406

IS - 3

ER -

Thomas S, Gough S, Broad MA, Cross J, Harden B, Ritson P et al. On-call competence: Developing a tool for self-assessment. Physiotherapy. 2008 Sep 1;94(3):204-211. https://doi.org/10.1016/j.physio.2008.02.006