Problem-problem solver characteristics affecting the calibration of judgments

Research output: Contribution to journalArticleResearchpeer-review

14 Citations (Scopus)

Abstract

The purpose of this paper is to examine factors that affect the calibration of judgments by systematically comparing experts' judgments to novices' when solving a complex, real-world problem that varies in its initial characteristics. Calibration in this context refers to the proportion of times decision makers provide a range about their best estimates that includes the actual outcome. We found that experts specify a narrower range and provide more accurate best estimates than novices. But their tighter ranges are not justified by their greater accuracy: they are less likely to encompass the actual outcome than are novices. However, this effect is attenuated when solving more complex problems. Novices apparently underestimate the complexity of difficult problems, hence the accuracy of their best estimates decreases as does the width of their ranges, resulting in worse calibration. The performance of experts was not significantly different across problem solving conditions. Both groups provided asymmetrical ranges about their best estimates, which suggests they account for the effect of subproblem dependencies.

Original languageEnglish
Pages (from-to)271-279
Number of pages9
JournalOrganizational Behavior and Human Decision Processes
Volume67
Issue number3
DOIs
Publication statusPublished - 1 Jan 1996
Externally publishedYes

Fingerprint

Calibration
Dependency (Psychology)

Cite this

@article{3dc7448768124a6db9d71a0e76403998,
title = "Problem-problem solver characteristics affecting the calibration of judgments",
abstract = "The purpose of this paper is to examine factors that affect the calibration of judgments by systematically comparing experts' judgments to novices' when solving a complex, real-world problem that varies in its initial characteristics. Calibration in this context refers to the proportion of times decision makers provide a range about their best estimates that includes the actual outcome. We found that experts specify a narrower range and provide more accurate best estimates than novices. But their tighter ranges are not justified by their greater accuracy: they are less likely to encompass the actual outcome than are novices. However, this effect is attenuated when solving more complex problems. Novices apparently underestimate the complexity of difficult problems, hence the accuracy of their best estimates decreases as does the width of their ranges, resulting in worse calibration. The performance of experts was not significantly different across problem solving conditions. Both groups provided asymmetrical ranges about their best estimates, which suggests they account for the effect of subproblem dependencies.",
author = "Spence, {Mark T.}",
year = "1996",
month = "1",
day = "1",
doi = "10.1006/obhd.1996.0079",
language = "English",
volume = "67",
pages = "271--279",
journal = "Organizational Behavior and Human Performance",
issn = "0749-5978",
publisher = "Academic Press Inc.",
number = "3",

}

Problem-problem solver characteristics affecting the calibration of judgments. / Spence, Mark T.

In: Organizational Behavior and Human Decision Processes, Vol. 67, No. 3, 01.01.1996, p. 271-279.

Research output: Contribution to journalArticleResearchpeer-review

TY - JOUR

T1 - Problem-problem solver characteristics affecting the calibration of judgments

AU - Spence, Mark T.

PY - 1996/1/1

Y1 - 1996/1/1

N2 - The purpose of this paper is to examine factors that affect the calibration of judgments by systematically comparing experts' judgments to novices' when solving a complex, real-world problem that varies in its initial characteristics. Calibration in this context refers to the proportion of times decision makers provide a range about their best estimates that includes the actual outcome. We found that experts specify a narrower range and provide more accurate best estimates than novices. But their tighter ranges are not justified by their greater accuracy: they are less likely to encompass the actual outcome than are novices. However, this effect is attenuated when solving more complex problems. Novices apparently underestimate the complexity of difficult problems, hence the accuracy of their best estimates decreases as does the width of their ranges, resulting in worse calibration. The performance of experts was not significantly different across problem solving conditions. Both groups provided asymmetrical ranges about their best estimates, which suggests they account for the effect of subproblem dependencies.

AB - The purpose of this paper is to examine factors that affect the calibration of judgments by systematically comparing experts' judgments to novices' when solving a complex, real-world problem that varies in its initial characteristics. Calibration in this context refers to the proportion of times decision makers provide a range about their best estimates that includes the actual outcome. We found that experts specify a narrower range and provide more accurate best estimates than novices. But their tighter ranges are not justified by their greater accuracy: they are less likely to encompass the actual outcome than are novices. However, this effect is attenuated when solving more complex problems. Novices apparently underestimate the complexity of difficult problems, hence the accuracy of their best estimates decreases as does the width of their ranges, resulting in worse calibration. The performance of experts was not significantly different across problem solving conditions. Both groups provided asymmetrical ranges about their best estimates, which suggests they account for the effect of subproblem dependencies.

UR - http://www.scopus.com/inward/record.url?scp=0030242136&partnerID=8YFLogxK

U2 - 10.1006/obhd.1996.0079

DO - 10.1006/obhd.1996.0079

M3 - Article

VL - 67

SP - 271

EP - 279

JO - Organizational Behavior and Human Performance

JF - Organizational Behavior and Human Performance

SN - 0749-5978

IS - 3

ER -