Intelligent Adaptive Gossip-Based Broadcast Protocol for UAV-MEC Using Multi-Agent Deep Reinforcement Learning
IEEE Transactions on Mobile Computing · 2024-06 · 23 (6) · 6563-6578
DOI: 10.1109/tmc.2023.3323296 ↗Kurz gefasst
Studienprotokoll in der Zeitschrift IEEE Transactions on Mobile Computing, 2024-06. Verfasst von Zhe Ren und 7 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 43 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Key Research and Development Projects of Shaanxi Province, Fundamental Research Funds for the Central Universities.
Abstract (Originalsprache)
Unmanned aerial vehicle (UAV)-assisted mobile edge computing (UAV-MEC) has been proposed to offer computing resources for smart devices and user equipment. UAV cluster aided MEC rather than one UAV-aided MEC as edge pool is the newest edge computing architecture. Unfortunately, the data packet exchange during edge computing within the UAV cluster hasn't received enough attention. UAVs need to collaborate for the wide implementation of MEC, relying on the gossip-based broadcast protocol. However, gossip has the problem of long propagation delay, where the forwarding probability and neighbors are two factors that are difficult to balance. The existing works improve gossip from only one factor, which cannot select suitable forwarding probability and avoid redundant messages. Besides, these schemes do not consider the historical packet reception of new neighbors when UAVs fly around, which decreases forwarding efficiency. To solve these problems, we first propose a data structure called Bitgraph that can record the historical packet reception of UAVs. Then, we formulate gossip broadcasting as a partially observable Markov decision process. Based on Bitgraph, we design the reward function. Finally, we design a multi-agent reinforcement learning algorithm, Branching Deep Graph Network (BDGN), which simultaneously makes decisions on forwarding probability and neighbors. Extensive experiments illustrate that our proposal gets more than 29% advantage in terms of the propagation delay and 20% advantage in terms of the redundant messages compared to the existing works.
Förderung
- National Natural Science Foundation of China
- Key Research and Development Projects of Shaanxi Province
- Fundamental Research Funds for the Central Universities
Zitieren
APA
Ren, Z., Li, X., Miao, Y., Li, Z., Wang, Z., Zhu, M., Liu, X., & Deng, R. H. (2024). Intelligent Adaptive Gossip-Based Broadcast Protocol for UAV-MEC Using Multi-Agent Deep Reinforcement Learning. IEEE Transactions on Mobile Computing, 23(6), 6563-6578. https://doi.org/10.1109/tmc.2023.3323296
Vancouver
Ren Z, Li X, Miao Y, Li Z, Wang Z, Zhu M, et al. Intelligent Adaptive Gossip-Based Broadcast Protocol for UAV-MEC Using Multi-Agent Deep Reinforcement Learning. IEEE Transactions on Mobile Computing. 2024;23(6):6563-6578. doi:10.1109/tmc.2023.3323296
BibTeX
@article{Ren2024,
author = {Ren, Zhe and Li, Xinghua and Miao, Yinbin and Li, Zhuowen and Wang, Zihao and Zhu, Mengyao and Liu, Ximeng and Deng, Robert H.},
title = {Intelligent Adaptive Gossip-Based Broadcast Protocol for UAV-MEC Using Multi-Agent Deep Reinforcement Learning},
journal = {IEEE Transactions on Mobile Computing},
year = {2024},
volume = {23},
number = {6},
pages = {6563--6578},
doi = {10.1109/tmc.2023.3323296}
}
EUVIMED