EUVIMEDEUVIMED entdecken
Crossref

Dual-Role Evaluation of Large Language Models in Cybersecurity: A Unified Framework for Offensive Generation and Defensive Intelligence

Vaibhavi Tiwari, Ola Suaifan, Ramy Othman

Journal of Engineering Research and Sciences · 21.11.2026 · 5 (11) · 96-118

DOI: 10.55708/js0511007 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Engineering Research and Sciences, online erschienen am 21.11.2026. Verfasst von Vaibhavi Tiwari und 2 weiteren Autor:innen. Die Arbeit nennt 5 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The rapid advancement of large language models (LLMs) is reshaping cybersecurity by strengthening defensive capabilities while simultaneously enabling increasingly sophisticated offensive threats. Despite this dual-use nature, existing evaluation methodologies remain fragmented and commonly assess LLMs in isolation as either offensive or defensive systems. This work presents a unified dual-role evaluation framework that characterizes LLM behavior within a shared cybersecurity context through a multi-dimensional taxonomy encompassing role, capability, intent, and contextual use. The framework is empirically evaluated under a strictly single-turn setting (T = 1), in which each offensive input is independently assessed through one corresponding defensive response. The evaluation covers phishing detection, prompt injection, log analysis, malware reasoning, vulnerability exploitation, and incident response using malicious, benign, and ambiguous scenarios. Experimental results demonstrate strong overall detection performance, low error rates, and effective handling of dual-use and borderline cases through ambiguity-aware classification. The findings further reveal the difficulty of distinguishing malicious intent from structurally similar benign inputs, underscoring the importance of context-sensitive evaluation and uncertainty-aware decision making in cybersecurity applications. Overall, the study establishes a controlled and reproducible single-turn baseline for evaluating offensive inputs and defensive LLM responses across diverse cybersecurity tasks.

Zitieren

APA

Tiwari, V., Suaifan, O., & Othman, R. (2026). Dual-Role Evaluation of Large Language Models in Cybersecurity: A Unified Framework for Offensive Generation and Defensive Intelligence. Journal of Engineering Research and Sciences, 5(11), 96-118. https://doi.org/10.55708/js0511007

Vancouver

Tiwari V, Suaifan O, Othman R. Dual-Role Evaluation of Large Language Models in Cybersecurity: A Unified Framework for Offensive Generation and Defensive Intelligence. Journal of Engineering Research and Sciences. 2026;5(11):96-118. doi:10.55708/js0511007

BibTeX
@article{Tiwari2026,
  author = {Tiwari, Vaibhavi and Suaifan, Ola and Othman, Ramy},
  title = {Dual-Role Evaluation of Large Language Models in Cybersecurity: A Unified Framework for Offensive Generation and Defensive Intelligence},
  journal = {Journal of Engineering Research and Sciences},
  year = {2026},
  volume = {5},
  number = {11},
  pages = {96--118},
  doi = {10.55708/js0511007}
}
Kostenlos starten →