EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Evaluating the Out-of-Domain Generalization in Source Code Vulnerability Detection

Nin Ho Le Viet, Tuan Nguyen Kim, Chieu Ta Quang

Engineering, Technology & Applied Science Research · 06.06.2026 · 16 (3) · 35548-35554

DOI: 10.48084/etasr.18302 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Engineering, Technology & Applied Science Research, online erschienen am 06.06.2026. Verfasst von Nin Ho Le Viet und 2 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 19 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Machine learning-based vulnerability detection is increasingly used in practice, yet most studies evaluate models only under in-domain settings. In real deployments, detectors often face code from different projects or data sources, leading to Out-of-Domain (OOD) performance degradation. This study proposes a systematic framework to evaluate OOD generalization in source code vulnerability detection. Experiments were conducted on widely used benchmarks, including Devign, Juliet Test Suite, Big-Vul, and National Vulnerability Database (NVD), with OOD test data stratified into Low, Medium, and High levels. The results indicate that accuracy and F1-score declined by 10-25% under OOD conditions, with the largest decrease reported at the High OOD level. Deep learning models, such as CodeBERT and GrapCodeBERT, are more efficient than traditional methods, including Support Vector Machine (SVM) and XGBoost; however, none of them remains stable across all domains. The proposed framework provides a practical basis for analyzing and improving OOD robustness.

Zitieren

APA

Viet, N. H. L., Kim, T. N., & Quang, C. T. (2026). Evaluating the Out-of-Domain Generalization in Source Code Vulnerability Detection. Engineering, Technology & Applied Science Research, 16(3), 35548-35554. https://doi.org/10.48084/etasr.18302

Vancouver

Viet NHL, Kim TN, Quang CT. Evaluating the Out-of-Domain Generalization in Source Code Vulnerability Detection. Engineering, Technology & Applied Science Research. 2026;16(3):35548-35554. doi:10.48084/etasr.18302

BibTeX
@article{Viet2026,
  author = {Viet, Nin Ho Le and Kim, Tuan Nguyen and Quang, Chieu Ta},
  title = {Evaluating the Out-of-Domain Generalization in Source Code Vulnerability Detection},
  journal = {Engineering, Technology & Applied Science Research},
  year = {2026},
  volume = {16},
  number = {3},
  pages = {35548--35554},
  doi = {10.48084/etasr.18302}
}
Kostenlos starten →