EUVIMEDSkopri EUVIMED
Crossref

Dual-Role Evaluation of Large Language Models in Cybersecurity: A Unified Framework for Offensive Generation and Defensive Intelligence

Vaibhavi Tiwari, Ola Suaifan, Ramy Othman

Journal of Engineering Research and Sciences · 2026-11-21 · 5 (11) · 96-118

DOI: 10.55708/js0511007 ↗

At a glance

Journal article in Journal of Engineering Research and Sciences, published online on 2026-11-21. Written by Vaibhavi Tiwari and 2 co-authors. 5 references.

AstrattDettalji biblijografiċiCiteRelated studies

Abstract (original language)

The rapid advancement of large language models (LLMs) is reshaping cybersecurity by strengthening defensive capabilities while simultaneously enabling increasingly sophisticated offensive threats. Despite this dual-use nature, existing evaluation methodologies remain fragmented and commonly assess LLMs in isolation as either offensive or defensive systems. This work presents a unified dual-role evaluation framework that characterizes LLM behavior within a shared cybersecurity context through a multi-dimensional taxonomy encompassing role, capability, intent, and contextual use. The framework is empirically evaluated under a strictly single-turn setting (T = 1), in which each offensive input is independently assessed through one corresponding defensive response. The evaluation covers phishing detection, prompt injection, log analysis, malware reasoning, vulnerability exploitation, and incident response using malicious, benign, and ambiguous scenarios. Experimental results demonstrate strong overall detection performance, low error rates, and effective handling of dual-use and borderline cases through ambiguity-aware classification. The findings further reveal the difficulty of distinguishing malicious intent from structurally similar benign inputs, underscoring the importance of context-sensitive evaluation and uncertainty-aware decision making in cybersecurity applications. Overall, the study establishes a controlled and reproducible single-turn baseline for evaluating offensive inputs and defensive LLM responses across diverse cybersecurity tasks.

Cite

APA

Tiwari, V., Suaifan, O., & Othman, R. (2026). Dual-Role Evaluation of Large Language Models in Cybersecurity: A Unified Framework for Offensive Generation and Defensive Intelligence. Journal of Engineering Research and Sciences, 5(11), 96-118. https://doi.org/10.55708/js0511007

Vancouver

Tiwari V, Suaifan O, Othman R. Dual-Role Evaluation of Large Language Models in Cybersecurity: A Unified Framework for Offensive Generation and Defensive Intelligence. Journal of Engineering Research and Sciences. 2026;5(11):96-118. doi:10.55708/js0511007

BibTeX
@article{Tiwari2026,
  author = {Tiwari, Vaibhavi and Suaifan, Ola and Othman, Ramy},
  title = {Dual-Role Evaluation of Large Language Models in Cybersecurity: A Unified Framework for Offensive Generation and Defensive Intelligence},
  journal = {Journal of Engineering Research and Sciences},
  year = {2026},
  volume = {5},
  number = {11},
  pages = {96--118},
  doi = {10.55708/js0511007}
}
Start for free →