Decentralized Navigation With Heterogeneous Federated Reinforcement Learning for UAV-Enabled Mobile Edge Computing
IEEE Transactions on Mobile Computing · 2024-12 · 23 (12) · 13621-13638
DOI: 10.1109/tmc.2024.3439696 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Mobile Computing, 2024-12. Verfasst von Pengfei Wang und 8 weiteren Autor:innen. Die Arbeit wurde bisher 48-mal zitiert (Crossref) und nennt 43 Literaturangaben. Gefördert von: National Science and Technology Major Project, National Natural Science Foundation of China, China Postdoctoral Science Foundation.
Abstract (Originalsprache)
Unmanned Aerial Vehicle (UAV)-enabled mobile edge computing has been proposed as an efficient task-offloading solution for user equipments (UEs). Nevertheless, the presence of heterogeneous UAVs makes centralized navigation policies impractical. Decentralized navigation policies also face significant challenges in knowledge sharing among heterogeneous UAVs. To address this, we present the soft hierarchical deep reinforcement learning network (SHDRLN) and dual-end federated reinforcement learning (DFRL) as a decentralized navigation policy solution. It enhances overall task-offloading energy efficiency for UAVs while facilitating knowledge sharing. Specifically, SHDRLN, a hierarchical DRL network based on maximum entropy learning, reduces policy differences among UAVs by abstracting atomic actions into generic skills. Simultaneously, it maximizes the average efficiency of all UAVs, optimizing coverage for UEs and minimizing task-offloading waiting time. DFRL, a federated learning (FL) algorithm, aggregates policy knowledge at the cloud server and filters it at the UAV end, enabling adaptive learning of navigation policy knowledge suitable for the UAV's performance parameters. Extensive simulations demonstrate that the proposed solution not only outperforms other baseline algorithms in overall energy efficiency but also achieves more stable navigation policy learning under different levels of heterogeneity of different UAV performance parameters.
Förderung
- National Science and Technology Major Project
- National Natural Science Foundation of China
- China Postdoctoral Science Foundation
- Science and Technology Project of Liaoning Province
- Dalian Science and Technology Talent Innovation Support Plan for Outstanding Young Scholars
- Open Project of Key Laboratory for Advanced Design and Intelligent Computing of the Ministry of Education
- Xiaomi Young Talents Program
- Fundamental Research Funds for the Central Universities
Zitieren
APA
Wang, P., Yang, H., Han, G., Yu, R., Yang, L., Sun, G., Qi, H., Wei, X., & Zhang, Q. (2024). Decentralized Navigation With Heterogeneous Federated Reinforcement Learning for UAV-Enabled Mobile Edge Computing. IEEE Transactions on Mobile Computing, 23(12), 13621-13638. https://doi.org/10.1109/tmc.2024.3439696
Vancouver
Wang P, Yang H, Han G, Yu R, Yang L, Sun G, et al. Decentralized Navigation With Heterogeneous Federated Reinforcement Learning for UAV-Enabled Mobile Edge Computing. IEEE Transactions on Mobile Computing. 2024;23(12):13621-13638. doi:10.1109/tmc.2024.3439696
BibTeX
@article{Wang2024,
author = {Wang, Pengfei and Yang, Hao and Han, Guangjie and Yu, Ruiyun and Yang, Leyou and Sun, Geng and Qi, Heng and Wei, Xiaopeng and Zhang, Qiang},
title = {Decentralized Navigation With Heterogeneous Federated Reinforcement Learning for UAV-Enabled Mobile Edge Computing},
journal = {IEEE Transactions on Mobile Computing},
year = {2024},
volume = {23},
number = {12},
pages = {13621--13638},
doi = {10.1109/tmc.2024.3439696}
}
EUVIMED