EUVIMEDEUVIMED entdecken
Crossref

Dual-Centralized Q -Network-Based Reinforcement Learning for Cooperative Path Planning of Multiple UAVs

Jinchao Chen, Chongde Ren, Yujiao Hu, Ying Zhang, Yantao Lu, Qing Li, Tao You, Joel J. P. C. Rodrigues

IEEE Transactions on Intelligent Transportation Systems · 2025-09 · 26 (9) · 13232-13246

DOI: 10.1109/tits.2025.3587392 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Intelligent Transportation Systems, 2025-09. Verfasst von Jinchao Chen und 7 weiteren Autor:innen. Die Arbeit wurde bisher 44-mal zitiert (Crossref) und nennt 45 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Key Research and Development Program of Shaanxi Province, Aeronautical Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Due to the low cost and high maneuverability, unmanned aerial vehicles (UAVs) have been commonly used and played an important role in both the civilian and military fields. Although UAVs can significantly achieve enhanced flexibility and extensibility for large-scale intelligent systems, they result in a serious path planning problem. Especially in complex environments with a large number of irregular obstacles, UAVs have to efficiently find near-optimization flight paths and automatically move to target positions to finish the group task while avoiding collisions and satisfying various constraints. In this work, we focus on the cooperative path planning problem of homogeneous UAVs and present a multi-agent reinforcement learning-based approach to solve the problem. First, with the UAV and obstacle models, we analyse the collision avoidance, motion continuity, and energy consumption constraints in UAV flying, and formulate the cooperative path planning problem as a multi-constraint combinatorial optimization one with a high computational complexity. Then, inspired by the twin delayed deep deterministic policy gradient algorithm where clipped dual Q-networks are used to decrease the overestimation error of critic networks, we propose a multi-agent reinforcement learning-based approach with a dual-centralized Q-network mechanism to automatically produce feasible and collision-free flight path for each UAV. Finally, simulation experiments are conducted in a multi-agent particle environment to evaluate the effectiveness and efficiency of the proposed approach.

Förderung

  • National Natural Science Foundation of China
  • Key Research and Development Program of Shaanxi Province
  • Aeronautical Science Foundation of China
  • Fundamental Research Funds for the Central Universities

Zitieren

APA

Chen, J., Ren, C., Hu, Y., Zhang, Y., Lu, Y., Li, Q., You, T., & Rodrigues, J. J. P. C. (2025). Dual-Centralized Q -Network-Based Reinforcement Learning for Cooperative Path Planning of Multiple UAVs. IEEE Transactions on Intelligent Transportation Systems, 26(9), 13232-13246. https://doi.org/10.1109/tits.2025.3587392

Vancouver

Chen J, Ren C, Hu Y, Zhang Y, Lu Y, Li Q, et al. Dual-Centralized Q -Network-Based Reinforcement Learning for Cooperative Path Planning of Multiple UAVs. IEEE Transactions on Intelligent Transportation Systems. 2025;26(9):13232-13246. doi:10.1109/tits.2025.3587392

BibTeX
@article{Chen2025,
  author = {Chen, Jinchao and Ren, Chongde and Hu, Yujiao and Zhang, Ying and Lu, Yantao and Li, Qing and You, Tao and Rodrigues, Joel J. P. C.},
  title = {Dual-Centralized Q -Network-Based Reinforcement Learning for Cooperative Path Planning of Multiple UAVs},
  journal = {IEEE Transactions on Intelligent Transportation Systems},
  year = {2025},
  volume = {26},
  number = {9},
  pages = {13232--13246},
  doi = {10.1109/tits.2025.3587392}
}
Kostenlos starten →