EUVIMEDEUVIMED entdecken
Open Access · CC BY-SA 4.0

Comparative Evaluation of TabKANet with Oversampling and Feature Selection Ablation for Software Defect Prediction

Muhammad Faza Azhiman Saputra, Setyo Wahyu Saputro, Mohammad Reza Faisal, Radityo Adi Nugroho, Andi Farmadi

Indonesian Journal of Electronics, Electromedical Engineering, and Medical Informatics · 16.08.2026 · 8 (3) · 351-364

DOI: 10.35882/ijeeemi.v8i3.351 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Indonesian Journal of Electronics, Electromedical Engineering, and Medical Informatics, online erschienen am 16.08.2026. Verfasst von Muhammad Faza Azhiman Saputra und 4 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Software defect prediction (SDP) focuses limited testing resources on the modules most likely to fail, but real-world software metric data are tabular, noisy, and severely class-imbalanced, which degrades conventional learners. The Kolmogorov-Arnold Network (KAN) and Transformer architectures recently achieved strong results on tabular data, yet their combined form, TabKANet, has not been evaluated for SDP, nor has the contribution of common preprocessing techniques been quantified. This study adapts and comparatively evaluates TabKANet against established baselines and measures the contribution of oversampling and feature selection through a structured ablation. Twelve all-numerical NASA Metrics Data Program datasets were used. The pipeline applied duplicate removal, MinMax normalization, effective class weighting, and stratified five-fold cross-validation, with oversampling (SMOTE) and Recursive Feature Elimination (RFE) inserted inside the training folds. Four TabKANet variants (A: base, B: +SMOTE, C: +RFE, D: +SMOTE+RFE) were compared with Multi-Layer Perceptron (MLP), standalone KAN, and TabNet, and differences were tested with the Wilcoxon signed-rank test at a 0.05 significance level. The base TabKANet (variant A) achieved the highest mean AUC of 0.7603, slightly ahead of MLP (0.7594) and KAN (0.7583) and well above TabNet (0.7092). Its advantage over TabNet was significant (p = 0.002), whereas it was statistically equivalent to MLP and KAN (p = 0.733). TabNet attained the highest recall (0.739) but the lowest precision (0.228), indicating over-prediction of defects, while TabKANet kept precision and recall balanced. In the ablation, SMOTE significantly reduced AUC (p = 0.042), RFE caused no significant change (p = 0.733), and their combination stayed neutral (p = 0.266). TabKANet therefore performed best without additional resampling. TabKANet is thus a competitive architecture for all-numerical, highly imbalanced SDP, matching strong neural baselines and surpassing TabNet, where effective class weighting alone suffices and SMOTE is counter-productive.

Zitieren

APA

Saputra, M. F. A., Saputro, S. W., Faisal, M. R., Nugroho, R. A., & Farmadi, A. (2026). Comparative Evaluation of TabKANet with Oversampling and Feature Selection Ablation for Software Defect Prediction. Indonesian Journal of Electronics, Electromedical Engineering, and Medical Informatics, 8(3), 351-364. https://doi.org/10.35882/ijeeemi.v8i3.351

Vancouver

Saputra MFA, Saputro SW, Faisal MR, Nugroho RA, Farmadi A. Comparative Evaluation of TabKANet with Oversampling and Feature Selection Ablation for Software Defect Prediction. Indonesian Journal of Electronics, Electromedical Engineering, and Medical Informatics. 2026;8(3):351-364. doi:10.35882/ijeeemi.v8i3.351

BibTeX
@article{Saputra2026,
  author = {Saputra, Muhammad Faza Azhiman and Saputro, Setyo Wahyu and Faisal, Mohammad Reza and Nugroho, Radityo Adi and Farmadi, Andi},
  title = {Comparative Evaluation of TabKANet with Oversampling and Feature Selection Ablation for Software Defect Prediction},
  journal = {Indonesian Journal of Electronics, Electromedical Engineering, and Medical Informatics},
  year = {2026},
  volume = {8},
  number = {3},
  pages = {351--364},
  doi = {10.35882/ijeeemi.v8i3.351}
}
Kostenlos starten →