Reliability diagnostics for post-hoc explanations in network intrusion detection: a SHAP–LIME agreement study
Frontiers in Big Data · 11.11.2026 · 9
DOI: 10.3389/fdata.2026.1934235 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Big Data, online erschienen am 11.11.2026. Verfasst von Burak Aggul. Die Arbeit nennt 27 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Introduction
High classification performance does not establish the reliability of post-hoc explanations in network intrusion detection.
Methods
This study evaluates SHAP and LIME by separating agreement between methods from within-method repeatability and prediction changes under feature replacement. Four classifiers are compared on CIC-IDS2017, UNSW-NB15, and NSL-KDD using five training seeds per task. Local explanation analyses focus on five fitted Transformers, with an additional NSL-KDD checkpoint to examine model-seed sensitivity. Shared-reference comparisons, sampling-budget tests, global and different-flow ranking controls, and matched random-feature replacements are used to assess the results.
Results
Mean top-five Jaccard agreement ranges from 0.15 to 0.40, while rank-biased overlap ranges from 0.24 to 0.55. However, much of this overlap also occurs between different flows with the same predicted class, limiting evidence of flow-specific agreement. Larger SHAP budgets improve within-method repeatability but do not ensure closer agreement with LIME. Under conditional-donor replacement, removing top-ranked features does not consistently reduce predicted-class probabilities more than random removal. Retaining these features better preserves the probabilities, although weak or unchanged replacements limit the interpretation.
Discussion
These findings show that agreement alone is insufficient to establish explanation reliability. For practical use, feature rankings should be evaluated alongside within-method repeatability and perturbation controls that measure actual input changes.
Zitieren
APA
Aggul, B. (2026). Reliability diagnostics for post-hoc explanations in network intrusion detection: a SHAP–LIME agreement study. Frontiers in Big Data, 9. https://doi.org/10.3389/fdata.2026.1934235
Vancouver
Aggul B. Reliability diagnostics for post-hoc explanations in network intrusion detection: a SHAP–LIME agreement study. Frontiers in Big Data. 2026;9. doi:10.3389/fdata.2026.1934235
BibTeX
@article{Aggul2026,
author = {Aggul, Burak},
title = {Reliability diagnostics for post-hoc explanations in network intrusion detection: a SHAP–LIME agreement study},
journal = {Frontiers in Big Data},
year = {2026},
volume = {9},
doi = {10.3389/fdata.2026.1934235}
}
EUVIMED