Multi-Agent Reinforcement Learning-Based Intelligent Game Guidance with Complex Constraint
Aerospace · 14.04.2026 · 13 (4) · 365
DOI: 10.3390/aerospace13040365 ↗Kurz gefasst
Fachartikel in der Zeitschrift Aerospace, online erschienen am 14.04.2026. Verfasst von Fucong Liu und 4 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation (NNSF) of China, Science fund for Distinguished Young People in Shaanxi Province.
Abstract (Originalsprache)
For the complex problems of multi-aircraft cooperative game guidance with No-Fly Zone (NFZ) avoidance and cross-task constraint propagation, a deep deterministic policy gradient algorithm with temporal awareness and priority cooperative optimization (TP-MADDPG) is proposed. Based on the three-body cooperative guidance, a new coupled guidance task is formed by adding the NFZ avoidance constraint. At the same time, considering the constraint compatibility problem in dynamic task switching, the cooperative aircraft are modeled as independent agents with differentiated policy networks. First, a nonlinear kinematic model of the three-body game constructed by Evader–Pursuer–Defender is established. And four complex constraint conditions, namely homing guidance, NFZ avoidance, collision avoidance, and cooperative guidance, are modeled separately. Secondly, the Long Short-Term Memory-based (LSTM) Actor–Critic framework is proposed to dynamically capture the evolution patterns of adversarial scenarios by mining hidden correlations in historical state-action sequences. This enables smooth policy transitions between the cooperative guidance phase and subsequent homing guidance phase, effectively addressing the challenges of environmental non-stationarity and temporal task dependencies. Then, a priority-driven adaptive sampling mechanism is proposed along with a heterogeneous roles cooperative reward function to specifically address credit assignment imbalance and sparse reward problems, respectively. The sampling mechanism capitalizes on the efficient retrieval properties of SumTree data structures while integrating bias correction techniques to expedite policy gradient convergence. The reward function utilizes the reward shaping method to formulate cooperative reward components that explicitly capture behavioral correlations among agents. Finally, simulations show that the proposed method significantly outperforms multi-agent reinforcement learning baselines, effectively improving the performance of cooperative game guidance under complex constraints.
Förderung
- National Natural Science Foundation (NNSF) of China
- Science fund for Distinguished Young People in Shaanxi Province
Zitieren
APA
Liu, F., Guo, Y., Wang, S., Wang, J., & Liu, Z. (2026). Multi-Agent Reinforcement Learning-Based Intelligent Game Guidance with Complex Constraint. Aerospace, 13(4), 365. https://doi.org/10.3390/aerospace13040365
Vancouver
Liu F, Guo Y, Wang S, Wang J, Liu Z. Multi-Agent Reinforcement Learning-Based Intelligent Game Guidance with Complex Constraint. Aerospace. 2026;13(4):365. doi:10.3390/aerospace13040365
BibTeX
@article{Liu2026,
author = {Liu, Fucong and Guo, Yang and Wang, Shaobo and Wang, Jin and Liu, Zhengquan},
title = {Multi-Agent Reinforcement Learning-Based Intelligent Game Guidance with Complex Constraint},
journal = {Aerospace},
year = {2026},
volume = {13},
number = {4},
pages = {365},
doi = {10.3390/aerospace13040365}
}
EUVIMED