Heterogeneous Multi-Agent Deep Reinforcement Learning for Cluster-Based Spectrum Sharing in UAV Swarms
Drones · 17.05.2025 · 9 (5) · 377
DOI: 10.3390/drones9050377 ↗Kurz gefasst
Fachartikel in der Zeitschrift Drones, online erschienen am 17.05.2025. Verfasst von Xiaomin Liao und 5 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
Unmanned aerial vehicle (UAV) swarms are widely applied in various fields, including military and civilian domains. However, due to the scarcity of spectrum resources, UAV swarm clustering technology has emerged as an effective method for achieving spectrum sharing among UAV swarms. This paper introduces a distributed heterogeneous multi-agent deep reinforcement learning algorithm, named HMDRL-UC, which is specifically designed to address the cluster-based spectrum sharing problem in heterogeneous UAV swarms. Heterogeneous UAV swarms consist of two types of UAVs: cluster head (CH) and cluster member (CM). Each UAV is equipped with an intelligent agent to execute the deep reinforcement learning (DRL) algorithm. Correspondingly, the HMDRL-UC consists of two parts: multi-agent proximal policy optimization for cluster head (MAPPO-H) and independent proximal policy optimization for cluster member (IPPO-M). The MAPPO-H enables the CHs to decide cluster selection and moving position, while CMs utilize IPPO-M to cluster autonomously under the condition of certain partial channel distribution information (CDI). Adequate experimental evidence has confirmed that the HMDRL-UC algorithm proposed in this paper is not only capable of managing dynamic drone swarm scenarios in the presence of partial CDI, but also has a clear advantage over the other existing three algorithms in terms of average throughput, intra-cluster communication delay, and minimum signal-to-noise ratio (SNR).
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Liao, X., Wang, Y., Han, Y., Li, Y., Lin, C., & Zhu, X. (2025). Heterogeneous Multi-Agent Deep Reinforcement Learning for Cluster-Based Spectrum Sharing in UAV Swarms. Drones, 9(5), 377. https://doi.org/10.3390/drones9050377
Vancouver
Liao X, Wang Y, Han Y, Li Y, Lin C, Zhu X. Heterogeneous Multi-Agent Deep Reinforcement Learning for Cluster-Based Spectrum Sharing in UAV Swarms. Drones. 2025;9(5):377. doi:10.3390/drones9050377
BibTeX
@article{Liao2025,
author = {Liao, Xiaomin and Wang, Yulai and Han, Yang and Li, You and Lin, Chushan and Zhu, Xuan},
title = {Heterogeneous Multi-Agent Deep Reinforcement Learning for Cluster-Based Spectrum Sharing in UAV Swarms},
journal = {Drones},
year = {2025},
volume = {9},
number = {5},
pages = {377},
doi = {10.3390/drones9050377}
}
EUVIMED