EUVIMEDDescubrir EUVIMED
Crossref

A new accuracy metric under three classes when subclasses are involved and its confidence interval estimation

Nan Nan iD, Lili Tian iD

Statistics in Medicine · 2023-12-10 · 42 (28) · 5207-5228

DOI: 10.1002/sim.9908 ↗

At a glance

Journal article in Statistics in Medicine, published online on 2023-10-02. Written by Nan Nan and 1 co-authors. Institution: Department of Biostatistics, University at Buffalo, Buffalo, New York, USA. Major MEDLINE topics: Alzheimer Disease. Cited 3 times so far (Crossref); 48 references.

ResumenSubjectsDatos bibliográficosCiteRelated studies

Abstract (original language)

“Compound multi‐class classification” refers to the setting where three or more main classes are involved and at least one of the main classes have multiple subclasses. A common practice in evaluating biomarker performance under “compound multi‐class classification” is “subclasses pooling.” In this article, we first explore the downsides of accuracy metrics based on pooled data. Then we propose a new accuracy measure proper for “compound multi‐class classification” with three ordinal main classes, namely “volume under compound surface ().” The proposed evaluates the accuracy of a biomarker appropriately by identifying main classes without requiring specification of an ordering for marker values of subclasses within each main class. For confidence interval estimation of , both parametric and nonparametric methods are studied, and simulation studies are carried out to assess coverage probabilities. A subset of Alzheimer's Disease Neuroimaging Initiative study dataset is analyzed.

Subjects

MeSH terms (MEDLINE)

Alzheimer DiseaseHumansROC CurveConfidence IntervalsComputer SimulationBiomarkers

Author keywords

Alzheimer's diseasebiomarker evaluationdiagnostic studiesgeneralized inferencevolume under ROC $$ \mathrm{ROC} $$ surface

Substances

Biomarkers

Authors and institutions

  • Department of Biostatistics, University at Buffalo, Buffalo, New York, USA.

ORCID profiles: Nan Nan, Lili Tian

Cite

APA

Nan, N., & Tian, L. (2023). A new accuracy metric under three classes when subclasses are involved and its confidence interval estimation. Statistics in Medicine, 42(28), 5207-5228. https://doi.org/10.1002/sim.9908

Vancouver

Nan N, Tian L. A new accuracy metric under three classes when subclasses are involved and its confidence interval estimation. Statistics in Medicine. 2023;42(28):5207-5228. doi:10.1002/sim.9908

BibTeX
@article{Nan2023,
  author = {Nan, Nan and Tian, Lili},
  title = {A new accuracy metric under three classes when subclasses are involved and its confidence interval estimation},
  journal = {Statistics in Medicine},
  year = {2023},
  volume = {42},
  number = {28},
  pages = {5207--5228},
  doi = {10.1002/sim.9908}
}
Start for free →