Evaluating the Out-of-Domain Generalization in Source Code Vulnerability Detection
Engineering, Technology & Applied Science Research · 06.06.2026 · 16 (3) · 35548-35554
DOI: 10.48084/etasr.18302 ↗Kurz gefasst
Fachartikel in der Zeitschrift Engineering, Technology & Applied Science Research, online erschienen am 06.06.2026. Verfasst von Nin Ho Le Viet und 2 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 19 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Machine learning-based vulnerability detection is increasingly used in practice, yet most studies evaluate models only under in-domain settings. In real deployments, detectors often face code from different projects or data sources, leading to Out-of-Domain (OOD) performance degradation. This study proposes a systematic framework to evaluate OOD generalization in source code vulnerability detection. Experiments were conducted on widely used benchmarks, including Devign, Juliet Test Suite, Big-Vul, and National Vulnerability Database (NVD), with OOD test data stratified into Low, Medium, and High levels. The results indicate that accuracy and F1-score declined by 10-25% under OOD conditions, with the largest decrease reported at the High OOD level. Deep learning models, such as CodeBERT and GrapCodeBERT, are more efficient than traditional methods, including Support Vector Machine (SVM) and XGBoost; however, none of them remains stable across all domains. The proposed framework provides a practical basis for analyzing and improving OOD robustness.
Zitieren
APA
Viet, N. H. L., Kim, T. N., & Quang, C. T. (2026). Evaluating the Out-of-Domain Generalization in Source Code Vulnerability Detection. Engineering, Technology & Applied Science Research, 16(3), 35548-35554. https://doi.org/10.48084/etasr.18302
Vancouver
Viet NHL, Kim TN, Quang CT. Evaluating the Out-of-Domain Generalization in Source Code Vulnerability Detection. Engineering, Technology & Applied Science Research. 2026;16(3):35548-35554. doi:10.48084/etasr.18302
BibTeX
@article{Viet2026,
author = {Viet, Nin Ho Le and Kim, Tuan Nguyen and Quang, Chieu Ta},
title = {Evaluating the Out-of-Domain Generalization in Source Code Vulnerability Detection},
journal = {Engineering, Technology & Applied Science Research},
year = {2026},
volume = {16},
number = {3},
pages = {35548--35554},
doi = {10.48084/etasr.18302}
}
EUVIMED