The Delphi Method for Graduate Research

Gregory James Skulmoski, Francis T. Hartman, Jennifer Krahn

Research output: Contribution to journalArticleResearchpeer-review

60 Downloads (Pure)

Abstract

The Delphi method is an attractive method for graduate students completing masters and PhD level research. It is a flexible research technique that has been successfully used in our program at the University of Calgary to explore new concepts within and outside of the information systems body of knowledge. The Delphi method is an iterative process to collect and distill the anonymous judgments of experts using a series of data collection and analysis techniques interspersed with feedback. The Delphi method is well suited as a research instrument when there is incomplete knowledge about a problem or phenomenon; however it is not a method for all types of IS research questions. The Delphi method works especially well when the goal is to improve our
understanding of problems, opportunities, solutions, or to develop forecasts. In this paper, we provide a brief background of the Classical Delphi followed by a presentation of how it has evolved into a flexible research method appropriate for a wide variety of IS research projects, such as determining the criteria for IS prototyping decisions, ranking technology management issues in new
product development projects, and developing a descriptive framework of knowledge manipulation activities. To illustrate the method’s flexibility, we summarize distinctive non-IS, IS, and graduate studies Delphi research projects. We end by discussing what we have learned from using the Delphi method in our own research regarding this method's design factors and how it may be applied to those conducting graduate studies research: i) methodological choices such as a qualitative, quantitative or mixed methods approach; ii) initial question degree of focus whether it be broad or narrowly focused; iii) expertise criteria such as technical knowledge and experience, capacity and willingness to participate, sufficient time, and communication skills; vi) number of
participants in the heterogeneous or homogeneous sample, v) number of Delphi rounds varying from one to 6, vi) mode of interaction such as through email, online surveys or groupware, vii) methodological rigor and a research audit trail, viii) results analysis, ix) further verification through triangulation or with another sample, and x) publishing of the results. We include an extensive bibliography and an appendix with a wide-ranging list of dissertations that have used the
Delphi method (including brief research description, number of rounds and sample size). The Delphi method is a flexible, effective and efficient research
method that can be successful used by IS graduate students to answer research
questions in information systems and to rigorously advance the IS body of
knowledge.
Original languageEnglish
Pages (from-to)1-21
Number of pages21
JournalJournal of Information Technology Education:Research
Volume6
DOIs
Publication statusPublished - 8 Feb 2007

Fingerprint

graduate
Information systems
research method
information system
research project
Students
Groupware
development of methods
Bibliographies
Electronic mail
Triangulation
triangulation
earning a doctorate
online survey
communication skills
audit
bibliography
development project
knowledge
manipulation

Cite this

@article{9805b4f4eed542f994526b895b3edeb2,
title = "The Delphi Method for Graduate Research",
abstract = "The Delphi method is an attractive method for graduate students completing masters and PhD level research. It is a flexible research technique that has been successfully used in our program at the University of Calgary to explore new concepts within and outside of the information systems body of knowledge. The Delphi method is an iterative process to collect and distill the anonymous judgments of experts using a series of data collection and analysis techniques interspersed with feedback. The Delphi method is well suited as a research instrument when there is incomplete knowledge about a problem or phenomenon; however it is not a method for all types of IS research questions. The Delphi method works especially well when the goal is to improve ourunderstanding of problems, opportunities, solutions, or to develop forecasts. In this paper, we provide a brief background of the Classical Delphi followed by a presentation of how it has evolved into a flexible research method appropriate for a wide variety of IS research projects, such as determining the criteria for IS prototyping decisions, ranking technology management issues in newproduct development projects, and developing a descriptive framework of knowledge manipulation activities. To illustrate the method’s flexibility, we summarize distinctive non-IS, IS, and graduate studies Delphi research projects. We end by discussing what we have learned from using the Delphi method in our own research regarding this method's design factors and how it may be applied to those conducting graduate studies research: i) methodological choices such as a qualitative, quantitative or mixed methods approach; ii) initial question degree of focus whether it be broad or narrowly focused; iii) expertise criteria such as technical knowledge and experience, capacity and willingness to participate, sufficient time, and communication skills; vi) number ofparticipants in the heterogeneous or homogeneous sample, v) number of Delphi rounds varying from one to 6, vi) mode of interaction such as through email, online surveys or groupware, vii) methodological rigor and a research audit trail, viii) results analysis, ix) further verification through triangulation or with another sample, and x) publishing of the results. We include an extensive bibliography and an appendix with a wide-ranging list of dissertations that have used theDelphi method (including brief research description, number of rounds and sample size). The Delphi method is a flexible, effective and efficient researchmethod that can be successful used by IS graduate students to answer researchquestions in information systems and to rigorously advance the IS body ofknowledge.",
author = "Skulmoski, {Gregory James} and Hartman, {Francis T.} and Jennifer Krahn",
year = "2007",
month = "2",
day = "8",
doi = "10.28945/199",
language = "English",
volume = "6",
pages = "1--21",
journal = "Journal of Information Technology Education:Research",
issn = "1539-3585",
publisher = "Informing Science Institute",

}

The Delphi Method for Graduate Research. / Skulmoski, Gregory James; Hartman, Francis T.; Krahn, Jennifer.

In: Journal of Information Technology Education:Research, Vol. 6, 08.02.2007, p. 1-21.

Research output: Contribution to journalArticleResearchpeer-review

TY - JOUR

T1 - The Delphi Method for Graduate Research

AU - Skulmoski, Gregory James

AU - Hartman, Francis T.

AU - Krahn, Jennifer

PY - 2007/2/8

Y1 - 2007/2/8

N2 - The Delphi method is an attractive method for graduate students completing masters and PhD level research. It is a flexible research technique that has been successfully used in our program at the University of Calgary to explore new concepts within and outside of the information systems body of knowledge. The Delphi method is an iterative process to collect and distill the anonymous judgments of experts using a series of data collection and analysis techniques interspersed with feedback. The Delphi method is well suited as a research instrument when there is incomplete knowledge about a problem or phenomenon; however it is not a method for all types of IS research questions. The Delphi method works especially well when the goal is to improve ourunderstanding of problems, opportunities, solutions, or to develop forecasts. In this paper, we provide a brief background of the Classical Delphi followed by a presentation of how it has evolved into a flexible research method appropriate for a wide variety of IS research projects, such as determining the criteria for IS prototyping decisions, ranking technology management issues in newproduct development projects, and developing a descriptive framework of knowledge manipulation activities. To illustrate the method’s flexibility, we summarize distinctive non-IS, IS, and graduate studies Delphi research projects. We end by discussing what we have learned from using the Delphi method in our own research regarding this method's design factors and how it may be applied to those conducting graduate studies research: i) methodological choices such as a qualitative, quantitative or mixed methods approach; ii) initial question degree of focus whether it be broad or narrowly focused; iii) expertise criteria such as technical knowledge and experience, capacity and willingness to participate, sufficient time, and communication skills; vi) number ofparticipants in the heterogeneous or homogeneous sample, v) number of Delphi rounds varying from one to 6, vi) mode of interaction such as through email, online surveys or groupware, vii) methodological rigor and a research audit trail, viii) results analysis, ix) further verification through triangulation or with another sample, and x) publishing of the results. We include an extensive bibliography and an appendix with a wide-ranging list of dissertations that have used theDelphi method (including brief research description, number of rounds and sample size). The Delphi method is a flexible, effective and efficient researchmethod that can be successful used by IS graduate students to answer researchquestions in information systems and to rigorously advance the IS body ofknowledge.

AB - The Delphi method is an attractive method for graduate students completing masters and PhD level research. It is a flexible research technique that has been successfully used in our program at the University of Calgary to explore new concepts within and outside of the information systems body of knowledge. The Delphi method is an iterative process to collect and distill the anonymous judgments of experts using a series of data collection and analysis techniques interspersed with feedback. The Delphi method is well suited as a research instrument when there is incomplete knowledge about a problem or phenomenon; however it is not a method for all types of IS research questions. The Delphi method works especially well when the goal is to improve ourunderstanding of problems, opportunities, solutions, or to develop forecasts. In this paper, we provide a brief background of the Classical Delphi followed by a presentation of how it has evolved into a flexible research method appropriate for a wide variety of IS research projects, such as determining the criteria for IS prototyping decisions, ranking technology management issues in newproduct development projects, and developing a descriptive framework of knowledge manipulation activities. To illustrate the method’s flexibility, we summarize distinctive non-IS, IS, and graduate studies Delphi research projects. We end by discussing what we have learned from using the Delphi method in our own research regarding this method's design factors and how it may be applied to those conducting graduate studies research: i) methodological choices such as a qualitative, quantitative or mixed methods approach; ii) initial question degree of focus whether it be broad or narrowly focused; iii) expertise criteria such as technical knowledge and experience, capacity and willingness to participate, sufficient time, and communication skills; vi) number ofparticipants in the heterogeneous or homogeneous sample, v) number of Delphi rounds varying from one to 6, vi) mode of interaction such as through email, online surveys or groupware, vii) methodological rigor and a research audit trail, viii) results analysis, ix) further verification through triangulation or with another sample, and x) publishing of the results. We include an extensive bibliography and an appendix with a wide-ranging list of dissertations that have used theDelphi method (including brief research description, number of rounds and sample size). The Delphi method is a flexible, effective and efficient researchmethod that can be successful used by IS graduate students to answer researchquestions in information systems and to rigorously advance the IS body ofknowledge.

U2 - 10.28945/199

DO - 10.28945/199

M3 - Article

VL - 6

SP - 1

EP - 21

JO - Journal of Information Technology Education:Research

JF - Journal of Information Technology Education:Research

SN - 1539-3585

ER -