EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Co-Adaptive Attacker–Defender Learning over Attack Graphs: A Stochastic Game Approach to Dynamic Network Defense

Mohammed A. Makarem, Muneef A. Razaz, Zead Saleh

Future Internet · 30.04.2026 · 18 (5) · 239

DOI: 10.3390/fi18050239 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Future Internet, online erschienen am 30.04.2026. Verfasst von Mohammed A. Makarem und 2 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The evolving landscape of cybersecurity threats, characterized by increasingly sophisticated and adaptive attackers, poses major challenges to traditional static network defense mechanisms. To address these limitations, this paper proposes an adaptive cyber defense framework that integrates Reinforcement Learning (RL) with Attack Graph (AG) modeling. The interaction between attacker and defender is formulated as a repeated zero-sum stochastic game over a partially observable Attack Graph-guided environment, allowing both agents to adapt their strategies through repeated interaction. Two value-based learning approaches are investigated, namely tabular Q-learning and Deep Q-Networks (DQN), under a unified attacker–defender setting. Experimental results across multiple training scenarios show that defender performance improves substantially as the training budget increases. Under limited training, Q-learning provides a computationally efficient and stable baseline, while DQN requires more training and careful tuning to achieve strong performance. However, with extended training, the DQN-based defender attains the highest win rate, albeit at a significantly greater computational cost. In addition, multi-run statistical comparisons highlight a clear trade-off between defensive effectiveness and runtime efficiency: Q-learning remains far more lightweight, whereas DQN offers stronger asymptotic performance when sufficient resources are available. These findings demonstrate the promise of learning-based adaptive defense over attack graphs while also emphasizing the importance of training budget, computational constraints, and model selection in practical cyber defense deployment.

Zitieren

APA

Makarem, M. A., Razaz, M. A., & Saleh, Z. (2026). Co-Adaptive Attacker–Defender Learning over Attack Graphs: A Stochastic Game Approach to Dynamic Network Defense. Future Internet, 18(5), 239. https://doi.org/10.3390/fi18050239

Vancouver

Makarem MA, Razaz MA, Saleh Z. Co-Adaptive Attacker–Defender Learning over Attack Graphs: A Stochastic Game Approach to Dynamic Network Defense. Future Internet. 2026;18(5):239. doi:10.3390/fi18050239

BibTeX
@article{Makarem2026,
  author = {Makarem, Mohammed A. and Razaz, Muneef A. and Saleh, Zead},
  title = {Co-Adaptive Attacker–Defender Learning over Attack Graphs: A Stochastic Game Approach to Dynamic Network Defense},
  journal = {Future Internet},
  year = {2026},
  volume = {18},
  number = {5},
  pages = {239},
  doi = {10.3390/fi18050239}
}
Kostenlos starten →