Stability of SHAP-Based Feature Importance Ranking under Class Imbalance, Feature Correlation, and Feature Dimensionality
Jurnal Statistika dan Komputasi · 30.06.2026 · 5 (1) · 113-128
DOI: 10.32665/statkom.v5i1.6455 ↗Kurz gefasst
Fachartikel in der Zeitschrift Jurnal Statistika dan Komputasi, online erschienen am 30.06.2026. Verfasst von Amri Luthfi Najih und 2 weiteren Autor:innen. Die Arbeit nennt 27 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).
Abstract (Originalsprache)
Background
Gradient boosting machine learning models, such as XGBoost and LightGBM, are widely used because of their high predictive performance. However, their complexity requires interpretation methods. SHAP is often used to explain feature contributions, but the stability of its interpretations may be affected by data characteristics and the model used.
Objective
This study evaluates the stability of SHAP-based feature importance rankings in XGBoost and LightGBM under various data conditions.
Methods
The study used controlled simulation and empirical BPJS Kesehatan claims data. In the simulation, 64 datasets were generated from combinations of minority class proportion, feature correlation, and number of features. The models were fitted repeatedly, and ranking stability was evaluated using Sequential Rank Agreement (SRA), where smaller values indicate more stable rankings.
Results
Higher feature correlation and extreme class imbalance reduced feature ranking stability. In the BPJS Kesehatan data, imbalance handling methods improved both model performance and interpretation stability. LightGBM with ADASYN produced a smaller SRA value (0.5350) than the model without imbalance handling (2.2534).
Conclusion
Feature correlation and class imbalance play an important role in determining the stability of SHAP interpretations. SMOTE and ADASYN improve predictive performance and increase the stability of feature importance rankings.
Zitieren
APA
Najih, A. L., Sartono, B., & Rahardiantoro, S. (2026). Stability of SHAP-Based Feature Importance Ranking under Class Imbalance, Feature Correlation, and Feature Dimensionality. Jurnal Statistika dan Komputasi, 5(1), 113-128. https://doi.org/10.32665/statkom.v5i1.6455
Vancouver
Najih AL, Sartono B, Rahardiantoro S. Stability of SHAP-Based Feature Importance Ranking under Class Imbalance, Feature Correlation, and Feature Dimensionality. Jurnal Statistika dan Komputasi. 2026;5(1):113-128. doi:10.32665/statkom.v5i1.6455
BibTeX
@article{Najih2026,
author = {Najih, Amri Luthfi and Sartono, Bagus and Rahardiantoro, Septian},
title = {Stability of SHAP-Based Feature Importance Ranking under Class Imbalance, Feature Correlation, and Feature Dimensionality},
journal = {Jurnal Statistika dan Komputasi},
year = {2026},
volume = {5},
number = {1},
pages = {113--128},
doi = {10.32665/statkom.v5i1.6455}
}
EUVIMED