Developing the accredited postgraduate assessment program for Fellowship of the Australian College of Rural and Remote Medicine.

J. D. Smith, D. Prideaux, C. L. Wolfe, T. J. Wilkinson, Tarun Sen Gupta, Dawn DeWitt, Paul Worley, R. B. Hays, Marita Cowie

Research output: Contribution to journalArticleResearchpeer-review

6 Citations (Scopus)

Abstract

INTRODUCTION: Accreditation of the Australian College of Rural and Remote Medicine (ACRRM) as a standards and training provider, by the Australian Medical Council (AMC) in 2007, is the first time in the world that a peak professional organisation for rural and remote medical education has been formally recognised. As a consequence, the Australian Government provided rural and remote medicine with formal recognition under Medicare as a generalist discipline. This accreditation was based on the ability of ACRRM to meet the AMC's guidelines for its training and assessment program. METHODS: The methodology was a six-step process that included: developing an assessment blueprint and a classification scheme; identifying an assessment model; choosing innovative summative and formative assessment methods that met the needs of rural and remote located medical practitioner candidates; 21 rural doctors and academics developing the assessment items as part of a week-long writing workshop; investigating the feasibility of purchasing assessment items; and 48 rural candidates piloting three of the assessment items to ensure they would meet the guidelines for national accreditation. RESULTS: The project resulted in an innovative formative and summative assessment program that occurs throughout 4 years of vocational training, using innovative, reliable, valid and acceptable methods with educational impact. The piloting process occurred for 3 of the 6 assessment tools. Structured Assessment Using Multiple Patient Scenarios (StAMPS) is a new assessment method developed as part of this project. The StAMPS pilot found that it was reliable, with a generalisability coefficient of >0.76 and was a valid, acceptable and feasible assessment tool with desired educational impact. The multiple choice question (MCQ) examination pilot found that the applied clinical nature of the questions and their wide range of scenarios proved a very acceptable examination to the profession. The web based in-training assessment examination pilot revealed that it would serve well as a formative process until ACRRM can further develop their MCQ database. CONCLUSIONS: The ACRRM assessment program breaks new ground for assessing rural and remote doctors in Australia, and provides new evidence regarding how a comprehensive and contemporary assessment system can work within a postgraduate medical setting.

Original languageEnglish
Number of pages12
JournalRural and Remote Health
Volume7
Issue number4
Publication statusPublished - 1 Oct 2007

Fingerprint

Medicine
medicine
Accreditation
Vocational Education
Guidelines
Education
Medicare
Medical Education
accreditation
Databases
scenario
examination
candidacy
vocational education
professional association
profession

Cite this

Smith, J. D. ; Prideaux, D. ; Wolfe, C. L. ; Wilkinson, T. J. ; Sen Gupta, Tarun ; DeWitt, Dawn ; Worley, Paul ; Hays, R. B. ; Cowie, Marita. / Developing the accredited postgraduate assessment program for Fellowship of the Australian College of Rural and Remote Medicine. In: Rural and Remote Health. 2007 ; Vol. 7, No. 4.
@article{086048833464488b987bb499cf55cf23,
title = "Developing the accredited postgraduate assessment program for Fellowship of the Australian College of Rural and Remote Medicine.",
abstract = "INTRODUCTION: Accreditation of the Australian College of Rural and Remote Medicine (ACRRM) as a standards and training provider, by the Australian Medical Council (AMC) in 2007, is the first time in the world that a peak professional organisation for rural and remote medical education has been formally recognised. As a consequence, the Australian Government provided rural and remote medicine with formal recognition under Medicare as a generalist discipline. This accreditation was based on the ability of ACRRM to meet the AMC's guidelines for its training and assessment program. METHODS: The methodology was a six-step process that included: developing an assessment blueprint and a classification scheme; identifying an assessment model; choosing innovative summative and formative assessment methods that met the needs of rural and remote located medical practitioner candidates; 21 rural doctors and academics developing the assessment items as part of a week-long writing workshop; investigating the feasibility of purchasing assessment items; and 48 rural candidates piloting three of the assessment items to ensure they would meet the guidelines for national accreditation. RESULTS: The project resulted in an innovative formative and summative assessment program that occurs throughout 4 years of vocational training, using innovative, reliable, valid and acceptable methods with educational impact. The piloting process occurred for 3 of the 6 assessment tools. Structured Assessment Using Multiple Patient Scenarios (StAMPS) is a new assessment method developed as part of this project. The StAMPS pilot found that it was reliable, with a generalisability coefficient of >0.76 and was a valid, acceptable and feasible assessment tool with desired educational impact. The multiple choice question (MCQ) examination pilot found that the applied clinical nature of the questions and their wide range of scenarios proved a very acceptable examination to the profession. The web based in-training assessment examination pilot revealed that it would serve well as a formative process until ACRRM can further develop their MCQ database. CONCLUSIONS: The ACRRM assessment program breaks new ground for assessing rural and remote doctors in Australia, and provides new evidence regarding how a comprehensive and contemporary assessment system can work within a postgraduate medical setting.",
author = "Smith, {J. D.} and D. Prideaux and Wolfe, {C. L.} and Wilkinson, {T. J.} and {Sen Gupta}, Tarun and Dawn DeWitt and Paul Worley and Hays, {R. B.} and Marita Cowie",
year = "2007",
month = "10",
day = "1",
language = "English",
volume = "7",
journal = "Rural and remote health [electronic resource].",
issn = "1445-6354",
publisher = "AUSTRALIAN RURAL HEALTH EDUC NETWORK",
number = "4",

}

Smith, JD, Prideaux, D, Wolfe, CL, Wilkinson, TJ, Sen Gupta, T, DeWitt, D, Worley, P, Hays, RB & Cowie, M 2007, 'Developing the accredited postgraduate assessment program for Fellowship of the Australian College of Rural and Remote Medicine.' Rural and Remote Health, vol. 7, no. 4.

Developing the accredited postgraduate assessment program for Fellowship of the Australian College of Rural and Remote Medicine. / Smith, J. D.; Prideaux, D.; Wolfe, C. L.; Wilkinson, T. J.; Sen Gupta, Tarun ; DeWitt, Dawn; Worley, Paul; Hays, R. B.; Cowie, Marita.

In: Rural and Remote Health, Vol. 7, No. 4, 01.10.2007.

Research output: Contribution to journalArticleResearchpeer-review

TY - JOUR

T1 - Developing the accredited postgraduate assessment program for Fellowship of the Australian College of Rural and Remote Medicine.

AU - Smith, J. D.

AU - Prideaux, D.

AU - Wolfe, C. L.

AU - Wilkinson, T. J.

AU - Sen Gupta, Tarun

AU - DeWitt, Dawn

AU - Worley, Paul

AU - Hays, R. B.

AU - Cowie, Marita

PY - 2007/10/1

Y1 - 2007/10/1

N2 - INTRODUCTION: Accreditation of the Australian College of Rural and Remote Medicine (ACRRM) as a standards and training provider, by the Australian Medical Council (AMC) in 2007, is the first time in the world that a peak professional organisation for rural and remote medical education has been formally recognised. As a consequence, the Australian Government provided rural and remote medicine with formal recognition under Medicare as a generalist discipline. This accreditation was based on the ability of ACRRM to meet the AMC's guidelines for its training and assessment program. METHODS: The methodology was a six-step process that included: developing an assessment blueprint and a classification scheme; identifying an assessment model; choosing innovative summative and formative assessment methods that met the needs of rural and remote located medical practitioner candidates; 21 rural doctors and academics developing the assessment items as part of a week-long writing workshop; investigating the feasibility of purchasing assessment items; and 48 rural candidates piloting three of the assessment items to ensure they would meet the guidelines for national accreditation. RESULTS: The project resulted in an innovative formative and summative assessment program that occurs throughout 4 years of vocational training, using innovative, reliable, valid and acceptable methods with educational impact. The piloting process occurred for 3 of the 6 assessment tools. Structured Assessment Using Multiple Patient Scenarios (StAMPS) is a new assessment method developed as part of this project. The StAMPS pilot found that it was reliable, with a generalisability coefficient of >0.76 and was a valid, acceptable and feasible assessment tool with desired educational impact. The multiple choice question (MCQ) examination pilot found that the applied clinical nature of the questions and their wide range of scenarios proved a very acceptable examination to the profession. The web based in-training assessment examination pilot revealed that it would serve well as a formative process until ACRRM can further develop their MCQ database. CONCLUSIONS: The ACRRM assessment program breaks new ground for assessing rural and remote doctors in Australia, and provides new evidence regarding how a comprehensive and contemporary assessment system can work within a postgraduate medical setting.

AB - INTRODUCTION: Accreditation of the Australian College of Rural and Remote Medicine (ACRRM) as a standards and training provider, by the Australian Medical Council (AMC) in 2007, is the first time in the world that a peak professional organisation for rural and remote medical education has been formally recognised. As a consequence, the Australian Government provided rural and remote medicine with formal recognition under Medicare as a generalist discipline. This accreditation was based on the ability of ACRRM to meet the AMC's guidelines for its training and assessment program. METHODS: The methodology was a six-step process that included: developing an assessment blueprint and a classification scheme; identifying an assessment model; choosing innovative summative and formative assessment methods that met the needs of rural and remote located medical practitioner candidates; 21 rural doctors and academics developing the assessment items as part of a week-long writing workshop; investigating the feasibility of purchasing assessment items; and 48 rural candidates piloting three of the assessment items to ensure they would meet the guidelines for national accreditation. RESULTS: The project resulted in an innovative formative and summative assessment program that occurs throughout 4 years of vocational training, using innovative, reliable, valid and acceptable methods with educational impact. The piloting process occurred for 3 of the 6 assessment tools. Structured Assessment Using Multiple Patient Scenarios (StAMPS) is a new assessment method developed as part of this project. The StAMPS pilot found that it was reliable, with a generalisability coefficient of >0.76 and was a valid, acceptable and feasible assessment tool with desired educational impact. The multiple choice question (MCQ) examination pilot found that the applied clinical nature of the questions and their wide range of scenarios proved a very acceptable examination to the profession. The web based in-training assessment examination pilot revealed that it would serve well as a formative process until ACRRM can further develop their MCQ database. CONCLUSIONS: The ACRRM assessment program breaks new ground for assessing rural and remote doctors in Australia, and provides new evidence regarding how a comprehensive and contemporary assessment system can work within a postgraduate medical setting.

UR - http://www.scopus.com/inward/record.url?scp=35748930566&partnerID=8YFLogxK

M3 - Article

VL - 7

JO - Rural and remote health [electronic resource].

JF - Rural and remote health [electronic resource].

SN - 1445-6354

IS - 4

ER -