EUVIMEDEUVIMED entdecken
Crossref

XGBoost for Educational Performance: Comparing SMOTE and SMOTE-TOMEK on Imbalanced Data

Ucta Pradema Sanjaya, Purwosiwi Pandansari, Ade Pratama, Rina Purwanti, Noor Laila Ramadhani, Ari Eko Budiyanto, Kristanti Kristanti, Iwan Setiawan Wibisono, Kustiyono Kustiyono, Agung Wibowo, Sri Mujiyono

Proceeding International Collaborative Conference on Multidisciplinary Science · 19.08.2025 · 2 (2) · 271-281

DOI: 10.70062/iccms.v2i2.165 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceeding International Collaborative Conference on Multidisciplinary Science, online erschienen am 19.08.2025. Verfasst von Ucta Pradema Sanjaya und 10 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Class imbalance poses a critical challenge in educational performance prediction, particularly in accurately identifying at-risk students within small datasets. This study rigorously evaluates three data balancing strategies—baseline imbalanced processing, SMOTE (Synthetic Minority Over-sampling Technique), and SMOTE-TOMEK—integrated with the XGBoost classifier, using academic records from 161 Indonesian junior high school students. The objective is to assess their effectiveness in improving minority-class recognition and overall model reliability. The results demonstrate that SMOTE-TOMEK significantly outperforms other methods, achieving a 75% recall for the minority class—representing a 50% absolute improvement over both SMOTE and the baseline. It also recorded the highest scores across key metrics: AUC-PR (0.9874), Matthews Correlation Coefficient (0.6786), and G-mean (0.8345). Notably, SMOTE-TOMEK identified one additional at-risk student for every four cases without compromising majority-class precision (93%), highlighting its practical utility in real-world educational interventions. In contrast, while SMOTE improved probabilistic metrics such as AUC-ROC (0.9286), it failed to reduce false negatives, maintaining the baseline’s 50% error rate in identifying at-risk students. The optimal SMOTE-TOMEK configuration enabled the use of shallower decision trees and stronger regularization, validating its effectiveness in reducing noise and enhancing generalization. Statistical significance of the results was confirmed using Wilcoxon signed-rank tests at a 0.01 significance level. These findings underscore the importance of hybrid resampling techniques in educational AI pipelines. SMOTE-TOMEK not only enhances predictive accuracy but also translates model performance into actionable insights for supporting marginalized learners. The study advocates for its prioritization in future educational data science applications, especially where early identification of vulnerable students is essential for targeted academic support and policy formulation.

Zitieren

APA

Sanjaya, U. P., Pandansari, P., Pratama, A., Purwanti, R., Ramadhani, N. L., Budiyanto, A. E., Kristanti, K., Wibisono, I. S., Kustiyono, K., Wibowo, A., & Mujiyono, S. (2025). XGBoost for Educational Performance: Comparing SMOTE and SMOTE-TOMEK on Imbalanced Data. Proceeding International Collaborative Conference on Multidisciplinary Science, 2(2), 271-281. https://doi.org/10.70062/iccms.v2i2.165

Vancouver

Sanjaya UP, Pandansari P, Pratama A, Purwanti R, Ramadhani NL, Budiyanto AE, et al. XGBoost for Educational Performance: Comparing SMOTE and SMOTE-TOMEK on Imbalanced Data. Proceeding International Collaborative Conference on Multidisciplinary Science. 2025;2(2):271-281. doi:10.70062/iccms.v2i2.165

BibTeX
@article{Sanjaya2025,
  author = {Sanjaya, Ucta Pradema and Pandansari, Purwosiwi and Pratama, Ade and Purwanti, Rina and Ramadhani, Noor Laila and Budiyanto, Ari Eko and Kristanti, Kristanti and Wibisono, Iwan Setiawan and Kustiyono, Kustiyono and Wibowo, Agung and Mujiyono, Sri},
  title = {XGBoost for Educational Performance: Comparing SMOTE and SMOTE-TOMEK on Imbalanced Data},
  journal = {Proceeding International Collaborative Conference on Multidisciplinary Science},
  year = {2025},
  volume = {2},
  number = {2},
  pages = {271--281},
  doi = {10.70062/iccms.v2i2.165}
}
Kostenlos starten →