EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Hierarchical reinforcement learning from competitive self-play for dual-aircraft formation air combat

Wei-ren Kong, De-yun Zhou, Ying Zhou, Yi-yang Zhao

Journal of Computational Design and Engineering · 10.03.2023 · 10 (2) · 830-859

DOI: 10.1093/jcde/qwad020 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Computational Design and Engineering, online erschienen am 03.03.2023. Verfasst von Wei-ren Kong und 3 weiteren Autor:innen. Die Arbeit wurde bisher 23-mal zitiert (Crossref) und nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: National Natural Science Foundation of China, Postdoctoral Science Foundation of Jiangsu Province, Fundamental Research Funds for the Central Universities.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The recent development of technology helps in the revolutionary war and it controls the war which is influenced by brilliant planning. The maneuver aircraft of intelligent algorithm aids the pilot to decide the particular position on the battlefield. Nowadays the hardware components of radar and missiles are widely used and the beyond visual range is the most popular method applied in air combat. The introduction of close-range air combat maneuver decisions generates the attention of researchers in artificial intelligence. Most of the existing methods are based on autonomous aircraft focused in air combat scenario but manual air combats are widely applied in dual aircraft. Based on the factors mentioned above, a novel hierarchical maneuver decision architecture is applied to a dual-aircraft close-range air combat scenario. Subsequently, the soft actor-critic algorithm is merged with competitive self-play which integrates the knowledge of sub-strategies. Further, the reinforcement learning technique is employed to achieve an approximate Nash equilibrium master strategy. The experimental results show that the hierarchical architecture exhibits good performance, symmetry, and robustness. The research generates a solution for intelligent formation of air combat in the future and guidance for manned or unmanned aircraft cooperative combat.

Förderung

  • National Natural Science Foundation of China
  • Postdoctoral Science Foundation of Jiangsu Province
  • Fundamental Research Funds for the Central Universities

Zitieren

APA

Kong, W., Zhou, D., Zhou, Y., & Zhao, Y. (2023). Hierarchical reinforcement learning from competitive self-play for dual-aircraft formation air combat. Journal of Computational Design and Engineering, 10(2), 830-859. https://doi.org/10.1093/jcde/qwad020

Vancouver

Kong W, Zhou D, Zhou Y, Zhao Y. Hierarchical reinforcement learning from competitive self-play for dual-aircraft formation air combat. Journal of Computational Design and Engineering. 2023;10(2):830-859. doi:10.1093/jcde/qwad020

BibTeX
@article{Kong2023,
  author = {Kong, Wei-ren and Zhou, De-yun and Zhou, Ying and Zhao, Yi-yang},
  title = {Hierarchical reinforcement learning from competitive self-play for dual-aircraft formation air combat},
  journal = {Journal of Computational Design and Engineering},
  year = {2023},
  volume = {10},
  number = {2},
  pages = {830--859},
  doi = {10.1093/jcde/qwad020}
}
Kostenlos starten →