Hallucinating Health: Assessing the Clinical Reliability of LIME, Grad-SHAP and Grad-CAM in Small-Scale Medical Imaging
International Journal on Engineering Technology · 18.06.2026 · 3 (2) · 71-80
DOI: 10.3126/injet.v3i2.95504 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal on Engineering Technology, online erschienen am 18.06.2026. Verfasst von Isu Sharma und 3 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Explainable Artificial Intelligence (XAI) methods such as Grad-CAM, SHAP, and LIME are increasingly employed in medical imaging to provide post-hoc interpretations of deep learning models. However, their reliability under data-scarce conditions remains insufficiently understood, despite being critical for real-world clinical deployment. In this work, we investigate the phenomenon of hallucinated explanations wherein XAI methods produce visually plausible but clinically ungrounded saliency maps due to models learning spurious correlations from limited training data. We conduct a controlled study on pediatric chest X-ray pneumonia classification by systematically reducing training set size (N = 1000 → 500 → 200 → 100 → 50) and evaluating explanation quality using perturbation-based faithfulness metrics, localization consistency, and qualitative clinical alignment. Our results demonstrate a non-linear degradation in explanation of reliability as dataset size decreases, with both gradient-based and perturbation-based methods exhibiting distinct failure modes. Notably, high model confidence persists even as explanation of faithfulness collapses, highlighting a critical decoupling between predictive performance and interpretability. We further evaluate mitigation strategies including data augmentation and transfer learning, finding that transfer learning partially stabilizes explanation fidelity but does not eliminate hallucination effects at very low sample sizes. These findings underscore the need for rigorous, quantitative evaluation of XAI methods prior to clinical adoption and suggest that commonly used saliency techniques may be unreliable in low-data regimes. This work contributes to a systematic framework for auditing XAI reliability in medical imaging and provides practical insights toward safer deployment of interpretable AI systems.
Zitieren
APA
Sharma, I., Kafle, A., Maharjan, A., & Moktan, B. (2026). Hallucinating Health: Assessing the Clinical Reliability of LIME, Grad-SHAP and Grad-CAM in Small-Scale Medical Imaging. International Journal on Engineering Technology, 3(2), 71-80. https://doi.org/10.3126/injet.v3i2.95504
Vancouver
Sharma I, Kafle A, Maharjan A, Moktan B. Hallucinating Health: Assessing the Clinical Reliability of LIME, Grad-SHAP and Grad-CAM in Small-Scale Medical Imaging. International Journal on Engineering Technology. 2026;3(2):71-80. doi:10.3126/injet.v3i2.95504
BibTeX
@article{Sharma2026,
author = {Sharma, Isu and Kafle, Aaditya and Maharjan, Aayush and Moktan, Bigyan},
title = {Hallucinating Health: Assessing the Clinical Reliability of LIME, Grad-SHAP and Grad-CAM in Small-Scale Medical Imaging},
journal = {International Journal on Engineering Technology},
year = {2026},
volume = {3},
number = {2},
pages = {71--80},
doi = {10.3126/injet.v3i2.95504}
}
EUVIMED