EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Reliability diagnostics for post-hoc explanations in network intrusion detection: a SHAP–LIME agreement study

Burak Aggul

Frontiers in Big Data · 11.11.2026 · 9

DOI: 10.3389/fdata.2026.1934235 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Big Data, online erschienen am 11.11.2026. Verfasst von Burak Aggul. Die Arbeit nennt 27 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Introduction

High classification performance does not establish the reliability of post-hoc explanations in network intrusion detection.

Methods

This study evaluates SHAP and LIME by separating agreement between methods from within-method repeatability and prediction changes under feature replacement. Four classifiers are compared on CIC-IDS2017, UNSW-NB15, and NSL-KDD using five training seeds per task. Local explanation analyses focus on five fitted Transformers, with an additional NSL-KDD checkpoint to examine model-seed sensitivity. Shared-reference comparisons, sampling-budget tests, global and different-flow ranking controls, and matched random-feature replacements are used to assess the results.

Results

Mean top-five Jaccard agreement ranges from 0.15 to 0.40, while rank-biased overlap ranges from 0.24 to 0.55. However, much of this overlap also occurs between different flows with the same predicted class, limiting evidence of flow-specific agreement. Larger SHAP budgets improve within-method repeatability but do not ensure closer agreement with LIME. Under conditional-donor replacement, removing top-ranked features does not consistently reduce predicted-class probabilities more than random removal. Retaining these features better preserves the probabilities, although weak or unchanged replacements limit the interpretation.

Discussion

These findings show that agreement alone is insufficient to establish explanation reliability. For practical use, feature rankings should be evaluated alongside within-method repeatability and perturbation controls that measure actual input changes.

Zitieren

APA

Aggul, B. (2026). Reliability diagnostics for post-hoc explanations in network intrusion detection: a SHAP–LIME agreement study. Frontiers in Big Data, 9. https://doi.org/10.3389/fdata.2026.1934235

Vancouver

Aggul B. Reliability diagnostics for post-hoc explanations in network intrusion detection: a SHAP–LIME agreement study. Frontiers in Big Data. 2026;9. doi:10.3389/fdata.2026.1934235

BibTeX
@article{Aggul2026,
  author = {Aggul, Burak},
  title = {Reliability diagnostics for post-hoc explanations in network intrusion detection: a SHAP–LIME agreement study},
  journal = {Frontiers in Big Data},
  year = {2026},
  volume = {9},
  doi = {10.3389/fdata.2026.1934235}
}
Kostenlos starten →