EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Analysis of the Precision of Large Language Models in the Identification of Security Vulnerabilities and Weaknesses in Generated Code

Federico Muñoz-Babiano, Paula Lamo, Ricardo S. Alonso

ADCAIJ: Advances in Distributed Computing and Artificial Intelligence Journal · 16.04.2026 · 14 · e32926

DOI: 10.14201/adcaij.32926 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ADCAIJ: Advances in Distributed Computing and Artificial Intelligence Journal, online erschienen am 16.04.2026. Verfasst von Federico Muñoz-Babiano und 2 weiteren Autor:innen. Die Arbeit nennt 72 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large Language Models (LLMs) have accelerated code generation, yet their security implications remain underexplored. This work evaluates the capability of eight general-purpose and code-specialized LLMs to detect weaknesses and vulnerabilities in generated code using CVE and CWE references. Stratified sampling of the CVEfixes dataset across five programming languages is assessed using precision, recall, F1-score, and relevance-oriented metrics (REINP, REINR, and REINF1). Results show limited detection of specific vulnerabilities (CVE), but better performance for general weaknesses (CWE), especially in Python and Ruby. We discuss limitations in model training and prompt conditioning, and outline improvements through dataset diversification, prompt engineering and hybrid human-in-the-loop approaches. The study highlights the current potential and limitations of LLMs for practical vulnerability detection in generated code.

Zitieren

APA

Muñoz-Babiano, F., Lamo, P., & Alonso, R. S. (2026). Analysis of the Precision of Large Language Models in the Identification of Security Vulnerabilities and Weaknesses in Generated Code. ADCAIJ: Advances in Distributed Computing and Artificial Intelligence Journal, 14, e32926. https://doi.org/10.14201/adcaij.32926

Vancouver

Muñoz-Babiano F, Lamo P, Alonso RS. Analysis of the Precision of Large Language Models in the Identification of Security Vulnerabilities and Weaknesses in Generated Code. ADCAIJ: Advances in Distributed Computing and Artificial Intelligence Journal. 2026;14:e32926. doi:10.14201/adcaij.32926

BibTeX
@article{MuozBabiano2026,
  author = {Muñoz-Babiano, Federico and Lamo, Paula and Alonso, Ricardo S.},
  title = {Analysis of the Precision of Large Language Models in the Identification of Security Vulnerabilities and Weaknesses in Generated Code},
  journal = {ADCAIJ: Advances in Distributed Computing and Artificial Intelligence Journal},
  year = {2026},
  volume = {14},
  pages = {e32926},
  doi = {10.14201/adcaij.32926}
}
Kostenlos starten →