EUVIMEDEUVIMED entdecken
Crossref

Decentralized Navigation With Heterogeneous Federated Reinforcement Learning for UAV-Enabled Mobile Edge Computing

Pengfei Wang, Hao Yang, Guangjie Han, Ruiyun Yu, Leyou Yang, Geng Sun, Heng Qi, Xiaopeng Wei, Qiang Zhang

IEEE Transactions on Mobile Computing · 2024-12 · 23 (12) · 13621-13638

DOI: 10.1109/tmc.2024.3439696 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Mobile Computing, 2024-12. Verfasst von Pengfei Wang und 8 weiteren Autor:innen. Die Arbeit wurde bisher 48-mal zitiert (Crossref) und nennt 43 Literaturangaben. Gefördert von: National Science and Technology Major Project, National Natural Science Foundation of China, China Postdoctoral Science Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Unmanned Aerial Vehicle (UAV)-enabled mobile edge computing has been proposed as an efficient task-offloading solution for user equipments (UEs). Nevertheless, the presence of heterogeneous UAVs makes centralized navigation policies impractical. Decentralized navigation policies also face significant challenges in knowledge sharing among heterogeneous UAVs. To address this, we present the soft hierarchical deep reinforcement learning network (SHDRLN) and dual-end federated reinforcement learning (DFRL) as a decentralized navigation policy solution. It enhances overall task-offloading energy efficiency for UAVs while facilitating knowledge sharing. Specifically, SHDRLN, a hierarchical DRL network based on maximum entropy learning, reduces policy differences among UAVs by abstracting atomic actions into generic skills. Simultaneously, it maximizes the average efficiency of all UAVs, optimizing coverage for UEs and minimizing task-offloading waiting time. DFRL, a federated learning (FL) algorithm, aggregates policy knowledge at the cloud server and filters it at the UAV end, enabling adaptive learning of navigation policy knowledge suitable for the UAV's performance parameters. Extensive simulations demonstrate that the proposed solution not only outperforms other baseline algorithms in overall energy efficiency but also achieves more stable navigation policy learning under different levels of heterogeneity of different UAV performance parameters.

Förderung

  • National Science and Technology Major Project
  • National Natural Science Foundation of China
  • China Postdoctoral Science Foundation
  • Science and Technology Project of Liaoning Province
  • Dalian Science and Technology Talent Innovation Support Plan for Outstanding Young Scholars
  • Open Project of Key Laboratory for Advanced Design and Intelligent Computing of the Ministry of Education
  • Xiaomi Young Talents Program
  • Fundamental Research Funds for the Central Universities

Zitieren

APA

Wang, P., Yang, H., Han, G., Yu, R., Yang, L., Sun, G., Qi, H., Wei, X., & Zhang, Q. (2024). Decentralized Navigation With Heterogeneous Federated Reinforcement Learning for UAV-Enabled Mobile Edge Computing. IEEE Transactions on Mobile Computing, 23(12), 13621-13638. https://doi.org/10.1109/tmc.2024.3439696

Vancouver

Wang P, Yang H, Han G, Yu R, Yang L, Sun G, et al. Decentralized Navigation With Heterogeneous Federated Reinforcement Learning for UAV-Enabled Mobile Edge Computing. IEEE Transactions on Mobile Computing. 2024;23(12):13621-13638. doi:10.1109/tmc.2024.3439696

BibTeX
@article{Wang2024,
  author = {Wang, Pengfei and Yang, Hao and Han, Guangjie and Yu, Ruiyun and Yang, Leyou and Sun, Geng and Qi, Heng and Wei, Xiaopeng and Zhang, Qiang},
  title = {Decentralized Navigation With Heterogeneous Federated Reinforcement Learning for UAV-Enabled Mobile Edge Computing},
  journal = {IEEE Transactions on Mobile Computing},
  year = {2024},
  volume = {23},
  number = {12},
  pages = {13621--13638},
  doi = {10.1109/tmc.2024.3439696}
}
Kostenlos starten →