AttackLogGen: Benchmarking LLMs for Generating Attack Logs
Digital Threats: Research and Practice · 30.09.2026 · 7 (3) · 1-25
DOI: 10.1145/3820170 ↗Kurz gefasst
Fachartikel in der Zeitschrift Digital Threats: Research and Practice, online erschienen am 06.08.2026. Verfasst von Ajeet Kumar und 2 weiteren Autor:innen. Die Arbeit nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: ANRF ECRG.
Abstract (Originalsprache)
Multi-Host Multi-Stage (MHMS) cyberattacks are increasingly sophisticated, spanning multiple systems through coordinated stages and evading traditional single-host detection approaches. Such attacks leave correlated traces across diverse log sources, including system, audit, and authentication logs. However, research on MHMS intrusion detection is constrained by the scarcity of realistic multi-host log datasets, as real-world data are difficult to share due to sensitivity and the operational complexity of reproducing attacks in controlled environments. To address this challenge, we present AttackLogGen, a framework for benchmarking Large Language Models (LLMs) in generating realistic MHMS logs. Malicious activities are modeled using the MITRE ATT&CK knowledge base, while benign background behavior is synthesized from generic event patterns across interconnected hosts. Leveraging LLM contextual reasoning, AttackLogGen produces logs that preserve causal dependencies, temporal ordering, and cross-host interactions characteristic of complex attacks. The framework integrates coordinated modules to generate time-aligned and semantically coherent system behavior. For validation, we built a small-scale MHMS testbed executing end-to-end multi-stage attacks to collect ground-truth logs, complemented by single-system data from the LogHub dataset. Evaluation across semantic similarity, distributional consistency, and discriminability tests shows that LLM-generated logs—particularly using GPT-4o-mini—closely approximate real MHMS activity, enabling safe and scalable experimentation for intrusion detection research.
Förderung
- ANRF ECRG
Zitieren
APA
Kumar, A., Mudiraj, J. M., & Yadav, G. (2026). AttackLogGen: Benchmarking LLMs for Generating Attack Logs. Digital Threats: Research and Practice, 7(3), 1-25. https://doi.org/10.1145/3820170
Vancouver
Kumar A, Mudiraj JM, Yadav G. AttackLogGen: Benchmarking LLMs for Generating Attack Logs. Digital Threats: Research and Practice. 2026;7(3):1-25. doi:10.1145/3820170
BibTeX
@article{Kumar2026,
author = {Kumar, Ajeet and Mudiraj, Jatin Manoj and Yadav, Geeta},
title = {AttackLogGen: Benchmarking LLMs for Generating Attack Logs},
journal = {Digital Threats: Research and Practice},
year = {2026},
volume = {7},
number = {3},
pages = {1--25},
doi = {10.1145/3820170}
}
EUVIMED