Spatio-Temporal Attention-Based Improved MADDPG Algorithm for Multi-UAV Formation Path Planning
Drones · 04.08.2026 · 10 (8) · 600
DOI: 10.3390/drones10080600 ↗Kurz gefasst
Fachartikel in der Zeitschrift Drones, online erschienen am 04.08.2026. Verfasst von Dong Zhao und 2 weiteren Autor:innen. Die Arbeit nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
With the increasing deployment of multi-unmanned aerial vehicle (multi-UAV) systems in dynamic environments, the problem of efficient cooperative path planning has emerged as a critical challenge requiring urgent solutions. To address this issue, this paper proposes a novel joint optimization framework, named spatio-temporal attention-based multi-agent deep deterministic policy gradient (STA-MADDPG). Rather than proposing a new reinforcement learning algorithm in the strict sense, this work integrates advanced spatial-temporal feature extraction with heuristic gradient guidance. First, a cascaded architecture combining multi-head attention and Long Short-Term Memory (LSTM) networks is utilized to extract key local and temporal features, thereby mitigating the dimensionality curse in dense multi-agent observations. Second, an improved dynamic artificial potential field (DAPF) is integrated into the reinforcement learning framework as a state augmentation mechanism, providing heuristic guidance vectors that accelerate convergence and improve obstacle avoidance. Furthermore, to balance computational complexity and adaptive behavior, a rule-based hierarchical formation strategy is designed. The framework maps predefined formations (elliptical, chain, or wedge) to specific environment categories, while the underlying MARL policy governs the dynamic trajectory planning and topology maintenance. Finally, rigorous comparative and ablation experiments are conducted to evaluate path length, search time, and relative position errors. Statistical analysis demonstrates the effectiveness of the proposed framework, achieving up to a 67.3% reduction in search time and a 91.56% search success rate compared with standard MARL baselines in complex environments.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Zhao, D., Dong, H., & Ren, W. (2026). Spatio-Temporal Attention-Based Improved MADDPG Algorithm for Multi-UAV Formation Path Planning. Drones, 10(8), 600. https://doi.org/10.3390/drones10080600
Vancouver
Zhao D, Dong H, Ren W. Spatio-Temporal Attention-Based Improved MADDPG Algorithm for Multi-UAV Formation Path Planning. Drones. 2026;10(8):600. doi:10.3390/drones10080600
BibTeX
@article{Zhao2026,
author = {Zhao, Dong and Dong, Huaizhi and Ren, Wenjing},
title = {Spatio-Temporal Attention-Based Improved MADDPG Algorithm for Multi-UAV Formation Path Planning},
journal = {Drones},
year = {2026},
volume = {10},
number = {8},
pages = {600},
doi = {10.3390/drones10080600}
}
EUVIMED