EUVIMEDEUVIMED entdecken
Open Access · CC BY-SA 4.0

Stability of SHAP-Based Feature Importance Ranking under Class Imbalance, Feature Correlation, and Feature Dimensionality

Amri Luthfi Najih, Bagus Sartono, Septian Rahardiantoro

Jurnal Statistika dan Komputasi · 30.06.2026 · 5 (1) · 113-128

DOI: 10.32665/statkom.v5i1.6455 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Jurnal Statistika dan Komputasi, online erschienen am 30.06.2026. Verfasst von Amri Luthfi Najih und 2 weiteren Autor:innen. Die Arbeit nennt 27 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Gradient boosting machine learning models, such as XGBoost and LightGBM, are widely used because of their high predictive performance. However, their complexity requires interpretation methods. SHAP is often used to explain feature contributions, but the stability of its interpretations may be affected by data characteristics and the model used.

Objective

This study evaluates the stability of SHAP-based feature importance rankings in XGBoost and LightGBM under various data conditions.

Methods

The study used controlled simulation and empirical BPJS Kesehatan claims data. In the simulation, 64 datasets were generated from combinations of minority class proportion, feature correlation, and number of features. The models were fitted repeatedly, and ranking stability was evaluated using Sequential Rank Agreement (SRA), where smaller values indicate more stable rankings.

Results

Higher feature correlation and extreme class imbalance reduced feature ranking stability. In the BPJS Kesehatan data, imbalance handling methods improved both model performance and interpretation stability. LightGBM with ADASYN produced a smaller SRA value (0.5350) than the model without imbalance handling (2.2534).

Conclusion

Feature correlation and class imbalance play an important role in determining the stability of SHAP interpretations. SMOTE and ADASYN improve predictive performance and increase the stability of feature importance rankings.

Zitieren

APA

Najih, A. L., Sartono, B., & Rahardiantoro, S. (2026). Stability of SHAP-Based Feature Importance Ranking under Class Imbalance, Feature Correlation, and Feature Dimensionality. Jurnal Statistika dan Komputasi, 5(1), 113-128. https://doi.org/10.32665/statkom.v5i1.6455

Vancouver

Najih AL, Sartono B, Rahardiantoro S. Stability of SHAP-Based Feature Importance Ranking under Class Imbalance, Feature Correlation, and Feature Dimensionality. Jurnal Statistika dan Komputasi. 2026;5(1):113-128. doi:10.32665/statkom.v5i1.6455

BibTeX
@article{Najih2026,
  author = {Najih, Amri Luthfi and Sartono, Bagus and Rahardiantoro, Septian},
  title = {Stability of SHAP-Based Feature Importance Ranking under Class Imbalance, Feature Correlation, and Feature Dimensionality},
  journal = {Jurnal Statistika dan Komputasi},
  year = {2026},
  volume = {5},
  number = {1},
  pages = {113--128},
  doi = {10.32665/statkom.v5i1.6455}
}
Kostenlos starten →