A Strategy on Selecting Performance Metrics for Classifier Evaluation
International Journal of Mobile Computing and Multimedia Communications · 01.10.2014 · 6 (4) · 20-35
DOI: 10.4018/ijmcmc.2014100102 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Mobile Computing and Multimedia Communications, erschienen am 01.10.2014. Verfasst von Yangguang Liu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 146-mal zitiert (Crossref).
Abstract (Originalsprache)
The evaluation of classifiers' performances plays a critical role in construction and selection of classification model. Although many performance metrics have been proposed in machine learning community, no general guidelines are available among practitioners regarding which metric to be selected for evaluating a classifier's performance. In this paper, we attempt to provide practitioners with a strategy on selecting performance metrics for classifier evaluation. Firstly, the authors investigate seven widely used performance metrics, namely classification accuracy, F-measure, kappa statistic, root mean square error, mean absolute error, the area under the receiver operating curve, and the area under the precision-recall curve. Secondly, the authors resort to using Pearson linear correlation and Spearman rank correlation to analyses the potential relationship among these seven metrics. Experimental results show that these commonly used metrics can be divided into three groups, and all metrics within a given group are highly correlated but less correlated with metrics from different groups.
Zitieren
APA
Liu, Y., Zhou, Y., Wen, S., & Tang, C. (2014). A Strategy on Selecting Performance Metrics for Classifier Evaluation. International Journal of Mobile Computing and Multimedia Communications, 6(4), 20-35. https://doi.org/10.4018/ijmcmc.2014100102
Vancouver
Liu Y, Zhou Y, Wen S, Tang C. A Strategy on Selecting Performance Metrics for Classifier Evaluation. International Journal of Mobile Computing and Multimedia Communications. 2014;6(4):20-35. doi:10.4018/ijmcmc.2014100102
BibTeX
@article{Liu2014,
author = {Liu, Yangguang and Zhou, Yangming and Wen, Shiting and Tang, Chaogang},
title = {A Strategy on Selecting Performance Metrics for Classifier Evaluation},
journal = {International Journal of Mobile Computing and Multimedia Communications},
year = {2014},
volume = {6},
number = {4},
pages = {20--35},
doi = {10.4018/ijmcmc.2014100102}
}
EUVIMED