Statistics and the peer review process in construction research

Rick Best, Narelle Smith

Research output: Chapter in Book/Report/Conference proceedingConference contributionResearchpeer-review

3 Citations (Scopus)

Abstract

This paper examines, in some detail, two papers published in 2003 and 2004 in respected journals. The papers had been through a typical peer review process, with one of the journals in question using four referees rather than the usual two. The papers under review have fundamental flaws. A number of criticisms of the papers are presented and some unfortunate misuse of statistical methods examined. The use of inappropriate statistical methods suggests that a simple analysis was perceived to be insufficiently "academic" and an attempt was made to give the appearance of more academic rigour than the topic or the data demanded. In conclusion it is argued that journals publishing papers with significant statistical content should ensure that at least one of the referees who examines submitted papers should be a mathematician or statistician, and all referees should be encouraged to decline to comment if they do not possess the statistical expertise to properly review the methods used.

Original languageEnglish
Title of host publicationQueensland University of Technology Research Week International Conference, QUT Research Week 2005 - Conference Proceedings
EditorsA.C. Sidwell
Publication statusPublished - 2005
Externally publishedYes
EventQueensland University of Technology Research Week International Conference, QUT Research Week 2005 - Brisbane, QLD, Australia
Duration: 4 Jul 20058 Jul 2005

Conference

ConferenceQueensland University of Technology Research Week International Conference, QUT Research Week 2005
CountryAustralia
CityBrisbane, QLD
Period4/07/058/07/05

Fingerprint

Statistics
Statistical methods
Defects
Review process
Referees
Peer review
Expertise
Criticism

Cite this

Best, R., & Smith, N. (2005). Statistics and the peer review process in construction research. In A. C. Sidwell (Ed.), Queensland University of Technology Research Week International Conference, QUT Research Week 2005 - Conference Proceedings
Best, Rick ; Smith, Narelle. / Statistics and the peer review process in construction research. Queensland University of Technology Research Week International Conference, QUT Research Week 2005 - Conference Proceedings. editor / A.C. Sidwell. 2005.
@inproceedings{3ca95b2a73e1446585f0c44fdc03b387,
title = "Statistics and the peer review process in construction research",
abstract = "This paper examines, in some detail, two papers published in 2003 and 2004 in respected journals. The papers had been through a typical peer review process, with one of the journals in question using four referees rather than the usual two. The papers under review have fundamental flaws. A number of criticisms of the papers are presented and some unfortunate misuse of statistical methods examined. The use of inappropriate statistical methods suggests that a simple analysis was perceived to be insufficiently {"}academic{"} and an attempt was made to give the appearance of more academic rigour than the topic or the data demanded. In conclusion it is argued that journals publishing papers with significant statistical content should ensure that at least one of the referees who examines submitted papers should be a mathematician or statistician, and all referees should be encouraged to decline to comment if they do not possess the statistical expertise to properly review the methods used.",
author = "Rick Best and Narelle Smith",
year = "2005",
language = "English",
isbn = "1741071011",
editor = "A.C. Sidwell",
booktitle = "Queensland University of Technology Research Week International Conference, QUT Research Week 2005 - Conference Proceedings",

}

Best, R & Smith, N 2005, Statistics and the peer review process in construction research. in AC Sidwell (ed.), Queensland University of Technology Research Week International Conference, QUT Research Week 2005 - Conference Proceedings. Queensland University of Technology Research Week International Conference, QUT Research Week 2005, Brisbane, QLD, Australia, 4/07/05.

Statistics and the peer review process in construction research. / Best, Rick; Smith, Narelle.

Queensland University of Technology Research Week International Conference, QUT Research Week 2005 - Conference Proceedings. ed. / A.C. Sidwell. 2005.

Research output: Chapter in Book/Report/Conference proceedingConference contributionResearchpeer-review

TY - GEN

T1 - Statistics and the peer review process in construction research

AU - Best, Rick

AU - Smith, Narelle

PY - 2005

Y1 - 2005

N2 - This paper examines, in some detail, two papers published in 2003 and 2004 in respected journals. The papers had been through a typical peer review process, with one of the journals in question using four referees rather than the usual two. The papers under review have fundamental flaws. A number of criticisms of the papers are presented and some unfortunate misuse of statistical methods examined. The use of inappropriate statistical methods suggests that a simple analysis was perceived to be insufficiently "academic" and an attempt was made to give the appearance of more academic rigour than the topic or the data demanded. In conclusion it is argued that journals publishing papers with significant statistical content should ensure that at least one of the referees who examines submitted papers should be a mathematician or statistician, and all referees should be encouraged to decline to comment if they do not possess the statistical expertise to properly review the methods used.

AB - This paper examines, in some detail, two papers published in 2003 and 2004 in respected journals. The papers had been through a typical peer review process, with one of the journals in question using four referees rather than the usual two. The papers under review have fundamental flaws. A number of criticisms of the papers are presented and some unfortunate misuse of statistical methods examined. The use of inappropriate statistical methods suggests that a simple analysis was perceived to be insufficiently "academic" and an attempt was made to give the appearance of more academic rigour than the topic or the data demanded. In conclusion it is argued that journals publishing papers with significant statistical content should ensure that at least one of the referees who examines submitted papers should be a mathematician or statistician, and all referees should be encouraged to decline to comment if they do not possess the statistical expertise to properly review the methods used.

UR - http://www.scopus.com/inward/record.url?scp=84859064935&partnerID=8YFLogxK

M3 - Conference contribution

SN - 1741071011

SN - 9781741071016

BT - Queensland University of Technology Research Week International Conference, QUT Research Week 2005 - Conference Proceedings

A2 - Sidwell, A.C.

ER -

Best R, Smith N. Statistics and the peer review process in construction research. In Sidwell AC, editor, Queensland University of Technology Research Week International Conference, QUT Research Week 2005 - Conference Proceedings. 2005