EUVIMEDObjevte EUVIMED
Open access · CC BY 4.0

Evaluating the Effectiveness of Explainable AI for Adversarial Attack Detection in Traffic Sign Recognition Systems

Bill Deng Pan, Yupeng Yang, Richard Guo, Yongxin Liu, Hongyun Chen, Dahai Liu

Mathematics · 2026-03-12 · 14 (6) · 971

DOI: 10.3390/math14060971 ↗

At a glance

Journal article in Mathematics, published online on 2026-03-12. Written by Bill Deng Pan and 5 co-authors. 43 references. The full text is freely available (open access, CC BY 4.0). Funded by: USDOT Tier-1 University Transportation Center (UTC) Transportation Cybersecurity Center for Advanced Research and Education.

AbstraktBibliografické údajeCiteRelated studies

Abstract (original language)

Connected autonomous vehicles (CAVs) rely on deep neural network-based perception systems to operate safely in complex driving environments. However, these systems remain vulnerable to adversarial perturbations that can induce misclassification without perceptible changes to human observers. Explainable artificial intelligence (XAI) has been proposed as a potential adversarial detection mechanism by exposing inconsistencies in model attention. This study evaluated the effectiveness of NoiseCAM-based explanation-space detection on the German Traffic Sign Recognition Benchmark (GTSRB) using a single 32 × 32 CNN architecture. Adversarial examples were generated using FGSM under perturbation budgets ϵ = 0.01–0.10, and detection performance was evaluated using accuracy, precision, recall, F1-score, and ROC–AUC. Results show that NoiseCAM achieves detection accuracies between 51.8% and 52.9% with ROC–AUC values of 0.52–0.53, only marginally above random discrimination (0.5). Class-wise analysis further reveals substantial variability in detection reliability across traffic sign categories, with visually structured regulatory signs exhibiting higher separability than complex warning signs. These findings suggest that explanation-space inconsistencies alone provide limited adversarial detection capability in low-resolution, safety-critical perception pipelines. The study contributes to the understanding of the operational limits of explanation-based adversarial detection and highlights the need to integrate XAI signals with complementary robustness or uncertainty-aware mechanisms for reliable deployment in autonomous driving systems.

Funding

  • USDOT Tier-1 University Transportation Center (UTC) Transportation Cybersecurity Center for Advanced Research and Education

Cite

APA

Pan, B. D., Yang, Y., Guo, R., Liu, Y., Chen, H., & Liu, D. (2026). Evaluating the Effectiveness of Explainable AI for Adversarial Attack Detection in Traffic Sign Recognition Systems. Mathematics, 14(6), 971. https://doi.org/10.3390/math14060971

Vancouver

Pan BD, Yang Y, Guo R, Liu Y, Chen H, Liu D. Evaluating the Effectiveness of Explainable AI for Adversarial Attack Detection in Traffic Sign Recognition Systems. Mathematics. 2026;14(6):971. doi:10.3390/math14060971

BibTeX
@article{Pan2026,
  author = {Pan, Bill Deng and Yang, Yupeng and Guo, Richard and Liu, Yongxin and Chen, Hongyun and Liu, Dahai},
  title = {Evaluating the Effectiveness of Explainable AI for Adversarial Attack Detection in Traffic Sign Recognition Systems},
  journal = {Mathematics},
  year = {2026},
  volume = {14},
  number = {6},
  pages = {971},
  doi = {10.3390/math14060971}
}
Start for free →