EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Multi-UAV Cooperative Air Combat Decision-Making Based on Multi-Agent Double-Soft Actor-Critic

Shaowei Li, Yongchao Wang, Yaoming Zhou, Yuhong Jia, Hanyue Shi, Fan Yang, Chaoyue Zhang

Aerospace · 21.06.2023 · 10 (7) · 574

DOI: 10.3390/aerospace10070574 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Aerospace, online erschienen am 21.06.2023. Verfasst von Shaowei Li und 6 weiteren Autor:innen. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Aeronautical Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multiple unmanned aerial vehicle (multi-UAV) cooperative air combat, which is an important form of future air combat, has high requirements for the autonomy and cooperation of unmanned aerial vehicles. Therefore, it is of great significance to study the decision-making method of multi-UAV cooperative air combat since the conventional methods are challenging to solve the high complexity and highly dynamic cooperative air combat problems. This paper proposes a multi-agent double-soft actor-critic (MADSAC) algorithm for solving the cooperative decision-making problem of multi-UAV. The MADSAC achieves multi-UAV cooperative air combat by treating the problem as a fully cooperative game using a decentralized partially observable Markov decision process and a centrally trained distributed execution framework. The use of maximum entropy theory in the update process makes the method more exploratory. Meanwhile, MADSAC uses double-centralized critics, target networks, and delayed policy updates to solve the overestimation and error accumulation problems effectively. In addition, the double-centralized critics based on the attention mechanism improve the scalability and learning efficiency of MADSAC. Finally, multi-UAV cooperative air combat experiments validate the effectiveness of MADSAC.

Förderung

  • National Natural Science Foundation of China
  • Aeronautical Science Foundation of China

Zitieren

APA

Li, S., Wang, Y., Zhou, Y., Jia, Y., Shi, H., Yang, F., & Zhang, C. (2023). Multi-UAV Cooperative Air Combat Decision-Making Based on Multi-Agent Double-Soft Actor-Critic. Aerospace, 10(7), 574. https://doi.org/10.3390/aerospace10070574

Vancouver

Li S, Wang Y, Zhou Y, Jia Y, Shi H, Yang F, et al. Multi-UAV Cooperative Air Combat Decision-Making Based on Multi-Agent Double-Soft Actor-Critic. Aerospace. 2023;10(7):574. doi:10.3390/aerospace10070574

BibTeX
@article{Li2023,
  author = {Li, Shaowei and Wang, Yongchao and Zhou, Yaoming and Jia, Yuhong and Shi, Hanyue and Yang, Fan and Zhang, Chaoyue},
  title = {Multi-UAV Cooperative Air Combat Decision-Making Based on Multi-Agent Double-Soft Actor-Critic},
  journal = {Aerospace},
  year = {2023},
  volume = {10},
  number = {7},
  pages = {574},
  doi = {10.3390/aerospace10070574}
}
Kostenlos starten →