EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Asymptotic Properties of Matthews Correlation Coefficient

Yuki Itaya iD, Jun Tamura iD, Kenichi Hayashi iD, Kouji Yamamoto

Statistics in Medicine · 15.01.2025 · 44 (1-2)

DOI: 10.1002/sim.10303 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Statistics in Medicine, online erschienen am 16.12.2024. Verfasst von Yuki Itaya und 3 weiteren Autor:innen. Beteiligte Einrichtung: Graduate School of Science and Technology, Keio University, Yokohama, Japan. Hauptthemen laut MEDLINE: Computer Simulation, Models, Statistical. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 25 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Japan Society for the Promotion of Science.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Evaluating classifications is crucial in statistics and machine learning, as it influences decision‐making across various fields, such as patient prognosis and therapy in critical conditions. The Matthews correlation coefficient (MCC), also known as the phi coefficient, is recognized as a performance metric with high reliability, offering a balanced measurement even in the presence of class imbalances. Despite its importance, there remains a notable lack of comprehensive research on the statistical inference of MCC. This deficiency often leads to studies merely validating and comparing MCC point estimates—a practice that, while common, overlooks the statistical significance and reliability of results. Addressing this research gap, our paper introduces and evaluates several methods to construct asymptotic confidence intervals for the single MCC and the differences between MCCs in paired designs. Through simulations across various scenarios, we evaluate the finite‐sample behavior of these methods and compare their performances. Furthermore, through real data analysis, we illustrate the potential utility of our findings in comparing binary classifiers, highlighting the possible contributions of our research in this field.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Computer SimulationModels, StatisticalHumansMachine LearningReproducibility of ResultsConfidence IntervalsData Interpretation, Statistical

Stichwörter der Autor:innen

MCCMatthews correlation coefficientclassificationconfidence intervalperformance metricstatistical inference

Autor:innen und Institutionen

  • Graduate School of Science and Technology, Keio University, Yokohama, Japan.
  • Graduate School of Medicine, Yokohama City University, Yokohama, Japan.
  • Department of Mathematics, Keio University, Yokohama, Japan.
  • Department of Biostatistics, School of Medicine, Yokohama City University, Yokohama, Japan.

ORCID-Profile: Yuki Itaya, Jun Tamura, Kenichi Hayashi

Förderung

  • Japan Society for the Promotion of Science

Zitieren

APA

Itaya, Y., Tamura, J., Hayashi, K., & Yamamoto, K. (2025). Asymptotic Properties of Matthews Correlation Coefficient. Statistics in Medicine, 44(1-2). https://doi.org/10.1002/sim.10303

Vancouver

Itaya Y, Tamura J, Hayashi K, Yamamoto K. Asymptotic Properties of Matthews Correlation Coefficient. Statistics in Medicine. 2025;44(1-2). doi:10.1002/sim.10303

BibTeX
@article{Itaya2025,
  author = {Itaya, Yuki and Tamura, Jun and Hayashi, Kenichi and Yamamoto, Kouji},
  title = {Asymptotic Properties of Matthews Correlation Coefficient},
  journal = {Statistics in Medicine},
  year = {2025},
  volume = {44},
  number = {1-2},
  doi = {10.1002/sim.10303}
}
Kostenlos starten →