EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Autonomous air combat decision‐making of UAV based on parallel self‐play reinforcement learning

Bo Li, Jingyi Huang, Shuangxia Bai, Zhigang Gan, Shiyang Liang, Neretin Evgeny, Shouwen Yao

CAAI Transactions on Intelligence Technology · 2023-03 · 8 (1) · 64-81

DOI: 10.1049/cit2.12109 ↗

Kurz gefasst

Fachartikel in der Zeitschrift CAAI Transactions on Intelligence Technology, online erschienen am 13.06.2022. Verfasst von Bo Li und 6 weiteren Autor:innen. Die Arbeit wurde bisher 60-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: Natural Science Foundation of Shaanxi Province.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Aiming at addressing the problem of manoeuvring decision‐making in UAV air combat, this study establishes a one‐to‐one air combat model, defines missile attack areas, and uses the non‐deterministic policy Soft‐Actor‐Critic (SAC) algorithm in deep reinforcement learning to construct a decision model to realize the manoeuvring process. At the same time, the complexity of the proposed algorithm is calculated, and the stability of the closed‐loop system of air combat decision‐making controlled by neural network is analysed by the Lyapunov function. This study defines the UAV air combat process as a gaming process and proposes a Parallel Self‐Play training SAC algorithm (PSP‐SAC) to improve the generalisation performance of UAV control decisions. Simulation results have shown that the proposed algorithm can realize sample sharing and policy sharing in multiple combat environments and can significantly improve the generalisation ability of the model compared to independent training.

Förderung

  • Natural Science Foundation of Shaanxi Province

Zitieren

APA

Li, B., Huang, J., Bai, S., Gan, Z., Liang, S., Evgeny, N., & Yao, S. (2023). Autonomous air combat decision‐making of UAV based on parallel self‐play reinforcement learning. CAAI Transactions on Intelligence Technology, 8(1), 64-81. https://doi.org/10.1049/cit2.12109

Vancouver

Li B, Huang J, Bai S, Gan Z, Liang S, Evgeny N, et al. Autonomous air combat decision‐making of UAV based on parallel self‐play reinforcement learning. CAAI Transactions on Intelligence Technology. 2023;8(1):64-81. doi:10.1049/cit2.12109

BibTeX
@article{Li2023,
  author = {Li, Bo and Huang, Jingyi and Bai, Shuangxia and Gan, Zhigang and Liang, Shiyang and Evgeny, Neretin and Yao, Shouwen},
  title = {Autonomous air combat decision‐making of UAV based on parallel self‐play reinforcement learning},
  journal = {CAAI Transactions on Intelligence Technology},
  year = {2023},
  volume = {8},
  number = {1},
  pages = {64--81},
  doi = {10.1049/cit2.12109}
}
Kostenlos starten →