A Multiagent Deep Reinforcement Learning Approach for Multi-UAV Cooperative Search in Multilayered Aerial Computing Networks
IEEE Internet of Things Journal · 01.03.2025 · 12 (5) · 5807-5821
DOI: 10.1109/jiot.2024.3490761 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Internet of Things Journal, erschienen am 01.03.2025. Verfasst von Jiaqi Wu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 20-mal zitiert (Crossref) und nennt 33 Literaturangaben. Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China, Shenzhen Science and Technology Program.
Abstract (Originalsprache)
Multi-UAV cooperative search (MCS) can significantly enhance the efficiency and effectiveness of search by enabling multiple unmanned aerial vehicles (UAVs) to collaborate in conducting search missions. Thus, it has played a vital role in various applications, such as surveillance, target detection, and information gathering. While existing works in this field mainly focused on a single UAV layer, in this work we consider a multilayered aerial computing network (MACN) scenario, which consists of a low-altitude platform (LAP) layer with multiple high-flexibility and low-capacity UAVs (called LUAVs) and a high-altitude platform (HAP) layer with one low-flexibility and high-capacity UAV (called HUAV). In such a scenario, We focus on the joint optimization of flying trajectories, computation offloading, and resource allocation, aiming at minimizing the uncertainty of search probability map (SPM), and meanwhile maximizing the number of target discovery and coverage rate. The problem is challenging due to the co-existence of discrete and continuous decision variables, as well as the fast and randomly changing of wireless environment. To solve the problem in an online and distributed manner, we propose a multiagent deep reinforcement learning (MADRL) approach based on the parameter sharing and action mask (PSAM), called PSAMMA, where the state-action-reward-state-action (SARSA) method is leveraged to determine the discrete flying and offloading decisions. Experiment results show that 1) the proposed PSAMMA algorithm outperforms existing algorithms in the literature, and can increase the average utility by 9.89%–31.15% and 2) we evaluate the search performance by analyzing the average uncertainty, target rate, and coverage rate under different parameter settings.
Förderung
- National Key Research and Development Program of China
- National Natural Science Foundation of China
- Shenzhen Science and Technology Program
- Basic and Applied Basic Research Foundation of Guangdong Province
- Natural Science Foundation of Guangdong Province
Zitieren
APA
Wu, J., Luo, J., Jiang, C., & Gao, L. (2025). A Multiagent Deep Reinforcement Learning Approach for Multi-UAV Cooperative Search in Multilayered Aerial Computing Networks. IEEE Internet of Things Journal, 12(5), 5807-5821. https://doi.org/10.1109/jiot.2024.3490761
Vancouver
Wu J, Luo J, Jiang C, Gao L. A Multiagent Deep Reinforcement Learning Approach for Multi-UAV Cooperative Search in Multilayered Aerial Computing Networks. IEEE Internet of Things Journal. 2025;12(5):5807-5821. doi:10.1109/jiot.2024.3490761
BibTeX
@article{Wu2025,
author = {Wu, Jiaqi and Luo, Jingjing and Jiang, Changkun and Gao, Lin},
title = {A Multiagent Deep Reinforcement Learning Approach for Multi-UAV Cooperative Search in Multilayered Aerial Computing Networks},
journal = {IEEE Internet of Things Journal},
year = {2025},
volume = {12},
number = {5},
pages = {5807--5821},
doi = {10.1109/jiot.2024.3490761}
}
EUVIMED