EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Explanation audits reveal silent failures of machine learning models under distribution shift

Faraz Masood, Sehba Masood, Arman Rasool Faridi, Andleeb Zoha, Arbaz Khan, Ali Haider Shamsan

Discover Artificial Intelligence · 24.08.2026 · 6 (1)

DOI: 10.1007/s44163-026-02012-6 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Discover Artificial Intelligence, online erschienen am 24.08.2026. Verfasst von Faraz Masood und 5 weiteren Autor:innen. Die Arbeit nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Confidence-based monitoring is commonly used to decide when a machine-learning classifier should abstain, request human review, or raise an alert. However, a model may remain highly confident while relying on a spurious feature whose relationship with the target changes after deployment. We define such a silent failure as a substantial increase in realised error without a commensurate increase in a confidence-based warning signal. This study examines whether confidence-derived and explanation-derived monitoring signals identify complementary failure modes in controlled tabular settings. We evaluate logistic regression, random forests, LightGBM, and XGBoost on three real-data benchmarks subjected to additive noise, random masking, and mean shift, together with a matched synthetic shortcut-reversal benchmark. Pointwise monitoring compares confidence-complement uncertainty, predictive entropy, output volatility, explanation volatility, and a hybrid score, whereas batch-level auditing uses Jensen–Shannon attribution-profile drift and top-k feature drift. Across three repeated stratified splits, confidence-complement uncertainty achieved the strongest pointwise error ranking, with a mean AUROC of 0.8664, compared with 0.7524 for output volatility, 0.5752 for explanation volatility, and 0.7847 for the hybrid score. Predictive entropy produced an almost identical ranking (0.8664), as expected for binary classification. At the batch level, attribution-profile drift showed the highest mean Spearman correlation with realised error (0.6808), exceeding mean uncertainty (0.6132). Sensitivity analysis over \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$T\in \{3,5,10,20\}$$\end{document} perturbations confirmed that the weak pointwise performance of explanation volatility was not caused by the perturbation count. Under strong shortcut reversal, tree-based models made many high-confidence errors while both occlusion and TreeSHAP audits remained concentrated on the spurious feature group. These results support a scoped monitoring strategy for similar tabular settings: confidence-derived scores are effective for pointwise screening, whereas group-aware explanation audits provide complementary evidence about stable but incorrect feature reliance.

Zitieren

APA

Masood, F., Masood, S., Faridi, A. R., Zoha, A., Khan, A., & Shamsan, A. H. (2026). Explanation audits reveal silent failures of machine learning models under distribution shift. Discover Artificial Intelligence, 6(1). https://doi.org/10.1007/s44163-026-02012-6

Vancouver

Masood F, Masood S, Faridi AR, Zoha A, Khan A, Shamsan AH. Explanation audits reveal silent failures of machine learning models under distribution shift. Discover Artificial Intelligence. 2026;6(1). doi:10.1007/s44163-026-02012-6

BibTeX
@article{Masood2026,
  author = {Masood, Faraz and Masood, Sehba and Faridi, Arman Rasool and Zoha, Andleeb and Khan, Arbaz and Shamsan, Ali Haider},
  title = {Explanation audits reveal silent failures of machine learning models under distribution shift},
  journal = {Discover Artificial Intelligence},
  year = {2026},
  volume = {6},
  number = {1},
  doi = {10.1007/s44163-026-02012-6}
}
Kostenlos starten →