Optimal selection of resampling methods for imbalanced data with high complexity
PLOS ONE · 27.07.2023 · 18 (7) · e0288540
DOI: 10.1371/journal.pone.0288540 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS ONE, online erschienen am 27.07.2023. Verfasst von Annie Kim und 1 weiteren Autor:innen. Beteiligte Einrichtung: Business Insight Team, Hyundai Autoever Corporation, Seoul, Republic of Korea. Hauptthemen laut MEDLINE: Algorithms. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Class imbalance is a major problem in classification, wherein the decision boundary is easily biased toward the majority class. A data-level solution (resampling) is one possible solution to this problem. However, several studies have shown that resampling methods can deteriorate the classification performance. This is because of the overgeneralization problem, which occurs when samples produced by the oversampling technique that should be represented in the minority class domain are introduced into the majority-class domain. This study shows that the overgeneralization problem is aggravated in complex data settings and introduces two alternate approaches to mitigate it. The first approach involves incorporating a filtering method into oversampling. The second approach is to apply undersampling. The main objective of this study is to provide guidance on selecting optimal resampling methods in imbalanced and complex datasets to improve classification performance. Simulation studies and real data analyses were performed to compare the resampling results in various scenarios with different complexities, imbalances, and sample sizes. In the case of noncomplex datasets, undersampling was found to be optimal. However, in the case of complex datasets, applying a filtering method to delete misallocated examples was optimal. In conclusion, this study can aid researchers in selecting the optimal method for resampling complex datasets.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Business Insight Team, Hyundai Autoever Corporation, Seoul, Republic of Korea.
- Department of Biomedical Systems Informatics, Division of Biostatistics, Yonsei University College of Medicine, Seoul, Republic of Korea.
ORCID-Profile: Inkyung Jung
Zitieren
APA
Kim, A., & Jung, I. (2023). Optimal selection of resampling methods for imbalanced data with high complexity. PLOS ONE, 18(7), e0288540. https://doi.org/10.1371/journal.pone.0288540
Vancouver
Kim A, Jung I. Optimal selection of resampling methods for imbalanced data with high complexity. PLOS ONE. 2023;18(7):e0288540. doi:10.1371/journal.pone.0288540
BibTeX
@article{Kim2023,
author = {Kim, Annie and Jung, Inkyung},
title = {Optimal selection of resampling methods for imbalanced data with high complexity},
journal = {PLOS ONE},
year = {2023},
volume = {18},
number = {7},
pages = {e0288540},
doi = {10.1371/journal.pone.0288540}
}
EUVIMED