EUVIMEDEUVIMED entdecken
Crossref

Unleashing the Power of Open Source Large Language Models for Cybersecurity: Key Insights and Challenges

Mounir Basbas, Badis Djamaa, Mustapha Reda Senouci

SECURITY AND PRIVACY · 2026-05 · 9 (3)

DOI: 10.1002/spy2.70223 ↗

Kurz gefasst

Fachartikel in der Zeitschrift SECURITY AND PRIVACY, online erschienen am 03.05.2026. Verfasst von Mounir Basbas und 2 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 116 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The rising rate of cyberattacks and the dearth of skilled cybersecurity professionals require innovative solutions beyond traditional security measures. Large Language Models (LLMs), known for their natural language processing abilities, present a viable way to improve cybersecurity defenses. However, despite LLMs' exploration in various security applications, systematic research aligning LLMs' contributions with established cybersecurity frameworks is lacking. To bridge this gap, this paper presents a systematic literature review aligned with the NIST Cybersecurity Framework (CSF 2.0) to gain a clear understanding of LLMs' multifaceted contributions and uncover their overlooked potential, particularly in areas such as the Awareness and Training category of the NIST CSF 2.0 Protect function. Leveraging the accessibility and privacy benefits of open‐source LLMs (OSLLMs), we developed a benchmarking methodology using Multiple‐Choice Question Answering (MCQA) to evaluate 21 OSLLMs recognized for their state‐of‐the‐art performance (e.g., Llama‐3‐70B and Qwen2‐72B, over 80% in MMLU) across two publicly available datasets. Our findings reveal that while larger LLMs generally outperformed smaller ones, medium‐sized LLMs (7B‐27B) achieved accuracy within 5–9 percentage points of 70B+ models, contesting the claim that model size alone dictates efficacy. These insights motivated a further investigation into optimized prompt engineering workflows using the DSPy framework. Our results reveal that advanced prompting techniques significantly boost the performance of smaller models, narrowing the performance gap with larger ones and broadening deployment possibilities. Furthermore, we introduced structural modifications and novel exit options to address position and forced‐choice biases in standard MCQA datasets, further enhancing the reliability of OSLLM evaluations. Overall, the results of this study not only strengthen our understanding of OSLLMs' aptitude in cybersecurity but also emphasize the impact of advanced prompt engineering and unbiased datasets in enhancing the capabilities of OSLLMs in cybersecurity.

Zitieren

APA

Basbas, M., Djamaa, B., & Senouci, M. R. (2026). Unleashing the Power of Open Source Large Language Models for Cybersecurity: Key Insights and Challenges. SECURITY AND PRIVACY, 9(3). https://doi.org/10.1002/spy2.70223

Vancouver

Basbas M, Djamaa B, Senouci MR. Unleashing the Power of Open Source Large Language Models for Cybersecurity: Key Insights and Challenges. SECURITY AND PRIVACY. 2026;9(3). doi:10.1002/spy2.70223

BibTeX
@article{Basbas2026,
  author = {Basbas, Mounir and Djamaa, Badis and Senouci, Mustapha Reda},
  title = {Unleashing the Power of Open Source Large Language Models for Cybersecurity: Key Insights and Challenges},
  journal = {SECURITY AND PRIVACY},
  year = {2026},
  volume = {9},
  number = {3},
  doi = {10.1002/spy2.70223}
}
Kostenlos starten →