EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

The receiver operating characteristic curve accurately assesses imbalanced datasets

Eve Richardson, Raphael Trevizani, Jason A Greenbaum, Hannah Carter, Morten Nielsen, Bjoern Peters

Patterns · 2024-06 · 5 (6) · 100994

DOI: 10.1016/j.patter.2024.100994 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Patterns, 2024-06. Verfasst von Eve Richardson und 5 weiteren Autor:innen. Beteiligte Einrichtung: Center for Infectious Disease and Vaccine Research, La Jolla Institute for Immunology, La Jolla, CA, USA. Die Arbeit wurde bisher 234-mal zitiert (Crossref) und nennt 43 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NCI NIH HHS, National Institute of Allergy and Infectious Diseases, National Institutes of Health.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Many problems in biology require looking for a "needle in a haystack," corresponding to a binary classification where there are a few positives within a much larger set of negatives, which is referred to as a class imbalance. The receiver operating characteristic (ROC) curve and the associated area under the curve (AUC) have been reported as ill-suited to evaluate prediction performance on imbalanced problems where there is more interest in performance on the positive minority class, while the precision-recall (PR) curve is preferable. We show via simulation and a real case study that this is a misinterpretation of the difference between the ROC and PR spaces, showing that the ROC curve is robust to class imbalance, while the PR curve is highly sensitive to class imbalance. Furthermore, we show that class imbalance cannot be easily disentangled from classifier performance measured via PR-AUC.

Schlagwörter

Stichwörter der Autor:innen

ROC curvebinary classificationimbalanced datamachine learningperformance metricprecision-recall

Autor:innen und Institutionen

  • Center for Infectious Disease and Vaccine Research, La Jolla Institute for Immunology, La Jolla, CA, USA.
  • Fiocruz Ceará, Fundação Oswaldo Cruz, Rua São José s/n, Precabura, Eusébio/CE, Brazil.
  • Department of Medicine, University of California, La Jolla, CA, USA.
  • Department of Health Technology, Section for Bioinformatics, Technical University of Denmark, Lyngby, Denmark.

Förderung

  • NCI NIH HHS
  • National Institute of Allergy and Infectious Diseases
  • National Institutes of Health
  • U.S. Department of Health and Human Services
  • National Cancer Institute

Zitieren

APA

Richardson, E., Trevizani, R., Greenbaum, J. A., Carter, H., Nielsen, M., & Peters, B. (2024). The receiver operating characteristic curve accurately assesses imbalanced datasets. Patterns, 5(6), 100994. https://doi.org/10.1016/j.patter.2024.100994

Vancouver

Richardson E, Trevizani R, Greenbaum JA, Carter H, Nielsen M, Peters B. The receiver operating characteristic curve accurately assesses imbalanced datasets. Patterns. 2024;5(6):100994. doi:10.1016/j.patter.2024.100994

BibTeX
@article{Richardson2024,
  author = {Richardson, Eve and Trevizani, Raphael and Greenbaum, Jason A and Carter, Hannah and Nielsen, Morten and Peters, Bjoern},
  title = {The receiver operating characteristic curve accurately assesses imbalanced datasets},
  journal = {Patterns},
  year = {2024},
  volume = {5},
  number = {6},
  pages = {100994},
  doi = {10.1016/j.patter.2024.100994}
}
Kostenlos starten →