EUVIMEDEUVIMED entdecken
StudienprotokollOpen Access · CC BY 4.0

An integrated evaluation protocol for adversarial robustness, generalization, and explanation stability in URL-based phishing detection

Tanvir Ahamed, Shawon Chakrabarty Kakon, Fahmid Al Farid, Jia Uddin, Hezerul Bin Abdul Karim

Frontiers in Computer Science · 31.08.2026 · 8

DOI: 10.3389/fcomp.2026.1834407 ↗

Kurz gefasst

Studienprotokoll in der Zeitschrift Frontiers in Computer Science, online erschienen am 31.08.2026. Verfasst von Tanvir Ahamed und 4 weiteren Autor:innen. Die Arbeit nennt 48 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Multimedia University.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Introduction

The reliability of phishing Uniform Resource Locator (URL) detectors under adversarial URL rewriting, domain shift, and explanation instability remains insufficiently understood. This study proposes an integrated robustness evaluation protocol for URL-based phishing detection, which integrates structured adversarial perturbation, unseen attack-family generalization, compositional attack effects, explanation stability, and external vulnerability transfer.

Methods

The protocol tests four representative model families: Logistic Regression, XGBoost, CharCNN, and BERT-base, using 235,370 validated URLs from PHIUSIIL, consisting of 100,520 phishing and 134,850 benign URLs, along with 49,121 PhishTank-validated phishing URLs for external validation.

Results

All models performed well on the clean test sets, ranging from 0.9962 to 0.9984, but their robustness decreased substantially under realistic URL mutations. Subdomain injection degraded the strong performance of Logistic Regression, XGBoost, and CharCNN to around 0.432, indicating collapse to the phishing-prevalence floor. BERT was highly susceptible to homoglyph, padding, and path-based perturbations. Leave-one-family-out evaluation also showed poor transfer to unseen subdomain attacks for both Logistic Regression and XGBoost, with Robustness Degradation Index values of 0.535 and 0.565, respectively. Explanation stability also suffered, with SHAP top-K Jaccard similarity dropping to 0.526-0.535 under subdomain perturbation.

Discussion

These results provide a solid benchmark for evaluating robustness-aware phishing URL detection for achieving deployable reliability under realistic adversarial and non-IID settings.

Förderung

  • Multimedia University

Zitieren

APA

Ahamed, T., Kakon, S. C., Farid, F. A., Uddin, J., & Karim, H. B. A. (2026). An integrated evaluation protocol for adversarial robustness, generalization, and explanation stability in URL-based phishing detection. Frontiers in Computer Science, 8. https://doi.org/10.3389/fcomp.2026.1834407

Vancouver

Ahamed T, Kakon SC, Farid FA, Uddin J, Karim HBA. An integrated evaluation protocol for adversarial robustness, generalization, and explanation stability in URL-based phishing detection. Frontiers in Computer Science. 2026;8. doi:10.3389/fcomp.2026.1834407

BibTeX
@article{Ahamed2026,
  author = {Ahamed, Tanvir and Kakon, Shawon Chakrabarty and Farid, Fahmid Al and Uddin, Jia and Karim, Hezerul Bin Abdul},
  title = {An integrated evaluation protocol for adversarial robustness, generalization, and explanation stability in URL-based phishing detection},
  journal = {Frontiers in Computer Science},
  year = {2026},
  volume = {8},
  doi = {10.3389/fcomp.2026.1834407}
}
Kostenlos starten →