EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Adversarial Decision-Making for Moving Target Defense: A Multi-Agent Markov Game and Reinforcement Learning Approach

Qian Yao iD, Yongjie Wang, Xinli Xiong, Peng Wang, Yang Li

Entropy · 02.04.2023 · 25 (4) · 605

DOI: 10.3390/e25040605 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Entropy, online erschienen am 02.04.2023. Verfasst von Qian Yao und 4 weiteren Autor:innen. Beteiligte Einrichtung: College of Electronic Engineering, National University of Defense Technology, Hefei 230037, China. Die Arbeit wurde bisher 34-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Reinforcement learning has shown a great ability and has defeated human beings in the field of real-time strategy games. In recent years, reinforcement learning has been used in cyberspace to carry out automated and intelligent attacks. Traditional defense methods are not enough to deal with this problem, so it is necessary to design defense agents to counter intelligent attacks. The interaction between the attack agent and the defense agent can be modeled as a multi-agent Markov game. In this paper, an adversarial decision-making approach that combines the Bayesian Strong Stackelberg and the WoLF algorithms was proposed to obtain the equilibrium point of multi-agent Markov games. With this method, the defense agent can obtain the adversarial decision-making strategy as well as continuously adjust the strategy in cyberspace. As verified in experiments, the defense agent should attach importance to short-term rewards in the process of a real-time game between the attack agent and the defense agent. The proposed approach can obtain the largest rewards for defense agent compared with the classic Nash-Q and URS-Q algorithms. In addition, the proposed approach adjusts the action selection probability dynamically, so that the decision entropy of optimal action gradually decreases.

Schlagwörter

Stichwörter der Autor:innen

decision-makingmoving target defensemulti-agent Markov gamesproactive defensereinforcement learning

Autor:innen und Institutionen

  • College of Electronic Engineering, National University of Defense Technology, Hefei 230037, China.
  • Anhui Province Key Laboratory of Cyberspace Security Situation Awareness and Evaluation, Hefei 230037, China.

ORCID-Profile: Qian Yao

Zitieren

APA

Yao, Q., Wang, Y., Xiong, X., Wang, P., & Li, Y. (2023). Adversarial Decision-Making for Moving Target Defense: A Multi-Agent Markov Game and Reinforcement Learning Approach. Entropy, 25(4), 605. https://doi.org/10.3390/e25040605

Vancouver

Yao Q, Wang Y, Xiong X, Wang P, Li Y. Adversarial Decision-Making for Moving Target Defense: A Multi-Agent Markov Game and Reinforcement Learning Approach. Entropy. 2023;25(4):605. doi:10.3390/e25040605

BibTeX
@article{Yao2023,
  author = {Yao, Qian and Wang, Yongjie and Xiong, Xinli and Wang, Peng and Li, Yang},
  title = {Adversarial Decision-Making for Moving Target Defense: A Multi-Agent Markov Game and Reinforcement Learning Approach},
  journal = {Entropy},
  year = {2023},
  volume = {25},
  number = {4},
  pages = {605},
  doi = {10.3390/e25040605}
}
Kostenlos starten →