Fair evaluation of classifier predictive performance based on binary confusion matrix
Computational Statistics · 2024-02 · 39 (1) · 363-383
DOI: 10.1007/s00180-022-01301-9 ↗Kurz gefasst
Fachartikel in der Zeitschrift Computational Statistics, online erschienen am 29.11.2022. Verfasst von Amalia Vanacore und 2 weiteren Autor:innen. Die Arbeit wurde bisher 51-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Università degli Studi di Napoli Federico II.
Abstract (Originalsprache)
Evaluating the ability of a classifier to make predictions on unseen data and increasing it by tweaking the learning algorithm are two of the main reasons motivating the evaluation of classifier predictive performance. In this study the behavior of Balanced $$AC_1$$ A C 1 — a novel classifier accuracy measure — is investigated under different class imbalance conditions via a Monte Carlo simulation. The behavior of Balanced $$AC_1$$ A C 1 is compared against that of several well-known performance measures based on binary confusion matrix. Study results reveal the suitability of Balanced $$AC_1$$ A C 1 with both balanced and imbalanced data sets. A real example of the effects of class imbalance on the behavior of the investigated classifier performance measures is provided by comparing the performance of several machine learning algorithms in a churn prediction problem.
Förderung
- Università degli Studi di Napoli Federico II
Zitieren
APA
Vanacore, A., Pellegrino, M. S., & Ciardiello, A. (2024). Fair evaluation of classifier predictive performance based on binary confusion matrix. Computational Statistics, 39(1), 363-383. https://doi.org/10.1007/s00180-022-01301-9
Vancouver
Vanacore A, Pellegrino MS, Ciardiello A. Fair evaluation of classifier predictive performance based on binary confusion matrix. Computational Statistics. 2024;39(1):363-383. doi:10.1007/s00180-022-01301-9
BibTeX
@article{Vanacore2024,
author = {Vanacore, Amalia and Pellegrino, Maria Sole and Ciardiello, Armando},
title = {Fair evaluation of classifier predictive performance based on binary confusion matrix},
journal = {Computational Statistics},
year = {2024},
volume = {39},
number = {1},
pages = {363--383},
doi = {10.1007/s00180-022-01301-9}
}
EUVIMED