A new accuracy metric under three classes when subclasses are involved and its confidence interval estimation
Statistics in Medicine · 2023-12-10 · 42 (28) · 5207-5228
DOI: 10.1002/sim.9908 ↗At a glance
Journal article in Statistics in Medicine, published online on 2023-10-02. Written by Nan Nan and 1 co-authors. Institution: Department of Biostatistics, University at Buffalo, Buffalo, New York, USA. Major MEDLINE topics: Alzheimer Disease. Cited 3 times so far (Crossref); 48 references.
Abstract (original language)
“Compound multi‐class classification” refers to the setting where three or more main classes are involved and at least one of the main classes have multiple subclasses. A common practice in evaluating biomarker performance under “compound multi‐class classification” is “subclasses pooling.” In this article, we first explore the downsides of accuracy metrics based on pooled data. Then we propose a new accuracy measure proper for “compound multi‐class classification” with three ordinal main classes, namely “volume under compound surface ().” The proposed evaluates the accuracy of a biomarker appropriately by identifying main classes without requiring specification of an ordering for marker values of subclasses within each main class. For confidence interval estimation of , both parametric and nonparametric methods are studied, and simulation studies are carried out to assess coverage probabilities. A subset of Alzheimer's Disease Neuroimaging Initiative study dataset is analyzed.
Subjects
MeSH terms (MEDLINE)
Author keywords
Substances
Authors and institutions
- Department of Biostatistics, University at Buffalo, Buffalo, New York, USA.
Cite
APA
Nan, N., & Tian, L. (2023). A new accuracy metric under three classes when subclasses are involved and its confidence interval estimation. Statistics in Medicine, 42(28), 5207-5228. https://doi.org/10.1002/sim.9908
Vancouver
Nan N, Tian L. A new accuracy metric under three classes when subclasses are involved and its confidence interval estimation. Statistics in Medicine. 2023;42(28):5207-5228. doi:10.1002/sim.9908
BibTeX
@article{Nan2023,
author = {Nan, Nan and Tian, Lili},
title = {A new accuracy metric under three classes when subclasses are involved and its confidence interval estimation},
journal = {Statistics in Medicine},
year = {2023},
volume = {42},
number = {28},
pages = {5207--5228},
doi = {10.1002/sim.9908}
}
EUVIMED