Information bias and adjusted profile likelihoods

Thomas J. Diciccio, Michael A. Martin, SE Stern, G. Alistair Young

Research output: Book/ReportCommissioned reportResearchpeer-review

Abstract

The bias and information bias of the ordinary profile score statistic are both typically of order O(1). Several additive adjustments to the profile score statistic that reduce its bias to order O(n(-1)) have been proposed. In certain situations, the information bias of these adjusted profile score statistics is also reduced to order O(n(-1)); specifically, the modified profile likelihood of Bamdorff-Nielsen yields an adjusted profile score statistic having both reduced bias and reduced information bias. In general, however, a bias reducing adjustment to the profile score statistic will not automatically reduce the order of the information bias as well. In this paper, an analytical formula is obtained for the information bias of a general bias-adjusted profile score statistic. This formula is used to compare bias reducing adjustments to the profile score statistic, as well as to construct further adjustments that reduce the information bias to O(n(-1)). Several examples are presented to illustrate use of the formula for information bias. In particular, the information bias formula may be utilized in a criterion for choosing between orthogonal parameterizations for the conditional profile likelihood of Cox and Reid.

Original languageEnglish
Place of PublicationStanford
PublisherStanford University Press
Number of pages15
Volume58
Publication statusPublished - 1996
Externally publishedYes

Cite this

Diciccio, T. J., Martin, M. A., Stern, SE., & Young, G. A. (1996). Information bias and adjusted profile likelihoods. Stanford: Stanford University Press.
Diciccio, Thomas J. ; Martin, Michael A. ; Stern, SE ; Young, G. Alistair. / Information bias and adjusted profile likelihoods. Stanford : Stanford University Press, 1996. 15 p.
@book{6b518c9d26a6429293e34099ff134602,
title = "Information bias and adjusted profile likelihoods",
abstract = "The bias and information bias of the ordinary profile score statistic are both typically of order O(1). Several additive adjustments to the profile score statistic that reduce its bias to order O(n(-1)) have been proposed. In certain situations, the information bias of these adjusted profile score statistics is also reduced to order O(n(-1)); specifically, the modified profile likelihood of Bamdorff-Nielsen yields an adjusted profile score statistic having both reduced bias and reduced information bias. In general, however, a bias reducing adjustment to the profile score statistic will not automatically reduce the order of the information bias as well. In this paper, an analytical formula is obtained for the information bias of a general bias-adjusted profile score statistic. This formula is used to compare bias reducing adjustments to the profile score statistic, as well as to construct further adjustments that reduce the information bias to O(n(-1)). Several examples are presented to illustrate use of the formula for information bias. In particular, the information bias formula may be utilized in a criterion for choosing between orthogonal parameterizations for the conditional profile likelihood of Cox and Reid.",
author = "Diciccio, {Thomas J.} and Martin, {Michael A.} and SE Stern and Young, {G. Alistair}",
year = "1996",
language = "English",
volume = "58",
publisher = "Stanford University Press",

}

Diciccio, TJ, Martin, MA, Stern, SE & Young, GA 1996, Information bias and adjusted profile likelihoods. vol. 58, Stanford University Press, Stanford.

Information bias and adjusted profile likelihoods. / Diciccio, Thomas J.; Martin, Michael A.; Stern, SE; Young, G. Alistair.

Stanford : Stanford University Press, 1996. 15 p.

Research output: Book/ReportCommissioned reportResearchpeer-review

TY - BOOK

T1 - Information bias and adjusted profile likelihoods

AU - Diciccio, Thomas J.

AU - Martin, Michael A.

AU - Stern, SE

AU - Young, G. Alistair

PY - 1996

Y1 - 1996

N2 - The bias and information bias of the ordinary profile score statistic are both typically of order O(1). Several additive adjustments to the profile score statistic that reduce its bias to order O(n(-1)) have been proposed. In certain situations, the information bias of these adjusted profile score statistics is also reduced to order O(n(-1)); specifically, the modified profile likelihood of Bamdorff-Nielsen yields an adjusted profile score statistic having both reduced bias and reduced information bias. In general, however, a bias reducing adjustment to the profile score statistic will not automatically reduce the order of the information bias as well. In this paper, an analytical formula is obtained for the information bias of a general bias-adjusted profile score statistic. This formula is used to compare bias reducing adjustments to the profile score statistic, as well as to construct further adjustments that reduce the information bias to O(n(-1)). Several examples are presented to illustrate use of the formula for information bias. In particular, the information bias formula may be utilized in a criterion for choosing between orthogonal parameterizations for the conditional profile likelihood of Cox and Reid.

AB - The bias and information bias of the ordinary profile score statistic are both typically of order O(1). Several additive adjustments to the profile score statistic that reduce its bias to order O(n(-1)) have been proposed. In certain situations, the information bias of these adjusted profile score statistics is also reduced to order O(n(-1)); specifically, the modified profile likelihood of Bamdorff-Nielsen yields an adjusted profile score statistic having both reduced bias and reduced information bias. In general, however, a bias reducing adjustment to the profile score statistic will not automatically reduce the order of the information bias as well. In this paper, an analytical formula is obtained for the information bias of a general bias-adjusted profile score statistic. This formula is used to compare bias reducing adjustments to the profile score statistic, as well as to construct further adjustments that reduce the information bias to O(n(-1)). Several examples are presented to illustrate use of the formula for information bias. In particular, the information bias formula may be utilized in a criterion for choosing between orthogonal parameterizations for the conditional profile likelihood of Cox and Reid.

M3 - Commissioned report

VL - 58

BT - Information bias and adjusted profile likelihoods

PB - Stanford University Press

CY - Stanford

ER -

Diciccio TJ, Martin MA, Stern SE, Young GA. Information bias and adjusted profile likelihoods. Stanford: Stanford University Press, 1996. 15 p.