The receiver operating characteristic curve accurately assesses imbalanced datasets
Patterns · 2024-06 · 5 (6) · 100994
DOI: 10.1016/j.patter.2024.100994 ↗Kurz gefasst
Fachartikel in der Zeitschrift Patterns, 2024-06. Verfasst von Eve Richardson und 5 weiteren Autor:innen. Beteiligte Einrichtung: Center for Infectious Disease and Vaccine Research, La Jolla Institute for Immunology, La Jolla, CA, USA. Die Arbeit wurde bisher 234-mal zitiert (Crossref) und nennt 43 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NCI NIH HHS, National Institute of Allergy and Infectious Diseases, National Institutes of Health.
Abstract (Originalsprache)
Many problems in biology require looking for a "needle in a haystack," corresponding to a binary classification where there are a few positives within a much larger set of negatives, which is referred to as a class imbalance. The receiver operating characteristic (ROC) curve and the associated area under the curve (AUC) have been reported as ill-suited to evaluate prediction performance on imbalanced problems where there is more interest in performance on the positive minority class, while the precision-recall (PR) curve is preferable. We show via simulation and a real case study that this is a misinterpretation of the difference between the ROC and PR spaces, showing that the ROC curve is robust to class imbalance, while the PR curve is highly sensitive to class imbalance. Furthermore, we show that class imbalance cannot be easily disentangled from classifier performance measured via PR-AUC.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Center for Infectious Disease and Vaccine Research, La Jolla Institute for Immunology, La Jolla, CA, USA.
- Fiocruz Ceará, Fundação Oswaldo Cruz, Rua São José s/n, Precabura, Eusébio/CE, Brazil.
- Department of Medicine, University of California, La Jolla, CA, USA.
- Department of Health Technology, Section for Bioinformatics, Technical University of Denmark, Lyngby, Denmark.
Förderung
- NCI NIH HHS
- National Institute of Allergy and Infectious Diseases
- National Institutes of Health
- U.S. Department of Health and Human Services
- National Cancer Institute
Zitieren
APA
Richardson, E., Trevizani, R., Greenbaum, J. A., Carter, H., Nielsen, M., & Peters, B. (2024). The receiver operating characteristic curve accurately assesses imbalanced datasets. Patterns, 5(6), 100994. https://doi.org/10.1016/j.patter.2024.100994
Vancouver
Richardson E, Trevizani R, Greenbaum JA, Carter H, Nielsen M, Peters B. The receiver operating characteristic curve accurately assesses imbalanced datasets. Patterns. 2024;5(6):100994. doi:10.1016/j.patter.2024.100994
BibTeX
@article{Richardson2024,
author = {Richardson, Eve and Trevizani, Raphael and Greenbaum, Jason A and Carter, Hannah and Nielsen, Morten and Peters, Bjoern},
title = {The receiver operating characteristic curve accurately assesses imbalanced datasets},
journal = {Patterns},
year = {2024},
volume = {5},
number = {6},
pages = {100994},
doi = {10.1016/j.patter.2024.100994}
}
EUVIMED