Multicategory reclassification statistics for assessing improvements in diagnostic accuracy

Jialiang Li, Binyan Jiang, Jason P. Fine

Research output: Journal article publicationJournal articleAcademic researchpeer-review

28 Citations (Scopus)

Abstract

In this paper, we extend the definitions of the net reclassification improvement (NRI) and the integrated discrimination improvement (IDI) in the context of multicategory classification. Both measures were proposed in Pencina and others (2008. Evaluating the added predictive ability of a new marker: from area under the receiver operating characteristic (ROC) curve to reclassification and beyond. Statistics in Medicine 27, 157-172) as numeric characterizations of accuracy improvement for binary diagnostic tests and were shown to have certain advantage over analyses based on ROC curves or other regression approaches. Estimation and inference procedures for the multiclass NRI and IDI are provided in this paper along with necessary asymptotic distributional results. Simulations are conducted to study the finite-sample properties of the proposed estimators. Two medical examples are considered to illustrate our methodology.
Original languageEnglish
Pages (from-to)382-394
Number of pages13
JournalBiostatistics
Volume14
Issue number2
DOIs
Publication statusPublished - 1 Apr 2013
Externally publishedYes

Keywords

  • Area under the ROC curve
  • Integrated discrimination improvement
  • Multicategory classification
  • Multinomial logistic regression
  • Net reclassification improvement

ASJC Scopus subject areas

  • Statistics and Probability
  • Medicine(all)
  • Statistics, Probability and Uncertainty

Cite this