Interaction effect between data discretization and data resampling for class-imbalanced medical datasets
Technology and Health Care · 2025
DOI: 10.1177/09287329241295874 ↗Kurz gefasst
Fachartikel in der Zeitschrift Technology and Health Care, 2025. Verfasst von Min-Wei Huang und 3 weiteren Autor:innen. Beteiligte Einrichtung: Kaohsiung Municipal Kai-Syuan Psychiatric Hospital, Kaohsiung. Hauptthemen laut MEDLINE: Algorithms, Data Mining, Databases, Factual. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 40 Literaturangaben. Gefördert von: Ministry of Science and Technology, Taiwan, Chang Gung Memorial Hospital, Linkou.
Abstract (Originalsprache)
Background
Data discretization is an important preprocessing step in data mining for the transfer of continuous feature values to discrete ones, which allows some specific data mining algorithms to construct more effective models and facilitates the data mining process. Because many medical domain datasets are class imbalanced, data resampling methods, including oversampling, undersampling, and hybrid sampling methods, have been widely applied to rebalance the training set, facilitating effective differentiation between majority and minority classes.
Objective
Herein, we examine the effect of incorporating both data discretization and data resampling as steps in the analytical process on the classifier performance for class-imbalanced medical datasets. The order in which these two steps are carried out is compared in the experiments.
Methods
Two experimental studies were conducted, one based on 11 two-class imbalanced medical datasets and the other using 3 multiclass imbalanced medical datasets. In addition, the two discretization algorithms employed are ChiMerge and minimum description length principle (MDLP). On the other hand, the data resampling algorithms chosen for performance comparison are Tomek links undersampling, synthetic minority oversampling technique (SMOTE) oversampling, and SMOTE–Tomek hybrid sampling algorithms. Moreover, the support vector machine (SVM), C4.5 decision tree, and random forest (RF) techniques were used to examine the classification performances of the different approaches.
Results
The results show that on average, the combination approaches can allow the classifiers to provide higher area under the ROC curve (AUC) rates than the best baseline approach at approximately 0.8%–3.5% and 0.9%–2.5% for twoclass and multiclass imbalanced medical datasets, respectively. Particularly, the optimal results for two-class imbalanced datasets are obtained by performing the MDLP method first for data discretization and SMOTE second for oversampling, providing the highest AUC rate and requiring the least computational cost. For multiclass imbalanced datasets, performing SMOTE or SMOTE–Tomek first for data resampling and ChiMerge second for data discretization offers the best performances.
Conclusions
Classifiers with oversampling can provide better performances than the baseline method without oversampling. In contrast, performing data discretization does not necessarily make the classifiers outperform the baselines. On average, the combination approaches have potential to allow the classifiers to provide higher AUC rates than the best baseline approach.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Kaohsiung Municipal Kai-Syuan Psychiatric Hospital, Kaohsiung.
- Department of Physical Therapy and Graduate Institute of Rehabilitation Science, China Medical University, Taichung.
- School of Medicine, College of Medicine, National Sun Yat-sen University, Kaohsiung.
- Department of Information Management, National Central University, Taoyuan.
- Department of Information Management, Chang Gung University, Taoyuan.
- Department of Digital Financial Technology, Chang Gung University, Taoyuan.
ORCID-Profile: Wei-Chao Lin
Förderung
- Ministry of Science and Technology, Taiwan
- Chang Gung Memorial Hospital, Linkou
Zitieren
APA
Huang, M. W., Tsai, C. F., Lin, W. C., & Lin, J. Y. (2025). Interaction effect between data discretization and data resampling for class-imbalanced medical datasets. Technology and Health Care. https://doi.org/10.1177/09287329241295874
Vancouver
Huang MW, Tsai CF, Lin WC, Lin JY. Interaction effect between data discretization and data resampling for class-imbalanced medical datasets. Technology and Health Care. 2025. doi:10.1177/09287329241295874
BibTeX
@article{Huang2025,
author = {Huang, Min-Wei and Tsai, Chih-Fong and Lin, Wei-Chao and Lin, Jia-Yang},
title = {Interaction effect between data discretization and data resampling for class-imbalanced medical datasets},
journal = {Technology and Health Care},
year = {2025},
doi = {10.1177/09287329241295874}
}
EUVIMED