Analysis of the Precision of Large Language Models in the Identification of Security Vulnerabilities and Weaknesses in Generated Code
ADCAIJ: Advances in Distributed Computing and Artificial Intelligence Journal · 16.04.2026 · 14 · e32926
DOI: 10.14201/adcaij.32926 ↗Kurz gefasst
Fachartikel in der Zeitschrift ADCAIJ: Advances in Distributed Computing and Artificial Intelligence Journal, online erschienen am 16.04.2026. Verfasst von Federico Muñoz-Babiano und 2 weiteren Autor:innen. Die Arbeit nennt 72 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
Large Language Models (LLMs) have accelerated code generation, yet their security implications remain underexplored. This work evaluates the capability of eight general-purpose and code-specialized LLMs to detect weaknesses and vulnerabilities in generated code using CVE and CWE references. Stratified sampling of the CVEfixes dataset across five programming languages is assessed using precision, recall, F1-score, and relevance-oriented metrics (REINP, REINR, and REINF1). Results show limited detection of specific vulnerabilities (CVE), but better performance for general weaknesses (CWE), especially in Python and Ruby. We discuss limitations in model training and prompt conditioning, and outline improvements through dataset diversification, prompt engineering and hybrid human-in-the-loop approaches. The study highlights the current potential and limitations of LLMs for practical vulnerability detection in generated code.
Zitieren
APA
Muñoz-Babiano, F., Lamo, P., & Alonso, R. S. (2026). Analysis of the Precision of Large Language Models in the Identification of Security Vulnerabilities and Weaknesses in Generated Code. ADCAIJ: Advances in Distributed Computing and Artificial Intelligence Journal, 14, e32926. https://doi.org/10.14201/adcaij.32926
Vancouver
Muñoz-Babiano F, Lamo P, Alonso RS. Analysis of the Precision of Large Language Models in the Identification of Security Vulnerabilities and Weaknesses in Generated Code. ADCAIJ: Advances in Distributed Computing and Artificial Intelligence Journal. 2026;14:e32926. doi:10.14201/adcaij.32926
BibTeX
@article{MuozBabiano2026,
author = {Muñoz-Babiano, Federico and Lamo, Paula and Alonso, Ricardo S.},
title = {Analysis of the Precision of Large Language Models in the Identification of Security Vulnerabilities and Weaknesses in Generated Code},
journal = {ADCAIJ: Advances in Distributed Computing and Artificial Intelligence Journal},
year = {2026},
volume = {14},
pages = {e32926},
doi = {10.14201/adcaij.32926}
}
EUVIMED