Deep Graph Reinforcement Learning for Mobile Edge Computing: Challenges and Solutions
IEEE Network · 2024-09 · 38 (5) · 314-323
DOI: 10.1109/mnet.2024.3383242 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Network, 2024-09. Verfasst von Yixiao Wang und 2 weiteren Autor:innen. Die Arbeit wurde bisher 21-mal zitiert (Crossref) und nennt 15 Literaturangaben. Gefördert von: Tianjin Municipal Science and Technology Program, National Natural Science Foundation of China.
Abstract (Originalsprache)
With the increasing Quality of Service (QoS) requirements of the Internet of Things (IoT), Mobile Edge Computing (MEC) has undoubtedly become a new paradigm for locating various resources in the proximity of User Equipment (UE) to alleviate the workload of backbone IoT networks. Deep Reinforcement Learning (DRL) has gained widespread popularity as a preferred methodology, primarily due to its capability to guide each User Equipment (UE) in making appropriate decisions within dynamic environments. However, traditional DRL algorithms cannot fully exploit the relationship between devices in the MEC graph. Here, we point out two typical IoT scenarios, i.e., task offloading decision-making when dependent tasks in resource-constrained Edge Servers (ESs) are generated in UEs and orchestration of cross-ESs distributed service, where the system cost is minimized by orchestrating hierarchical networks. To further enhance the performance of DRL, Graph Neural Networks (GNNs) and their variants provide promising generalization ability to wide IoT scenarios. We accordingly give concrete solutions for the above two typical scenarios, namely, Graph Neural Networks-Proximal Policy Optimization (GNNPPO) and Graph Neural Networks-Meta Reinforcement Learning (GNN-MRL), which combine GNN with a popular Actor-Critic scheme and newly developed MRL. Finally, we point out four worthwhile research directions for exploring GNN and DRL for AI-empowered MEC environments.
Förderung
- Tianjin Municipal Science and Technology Program
- National Natural Science Foundation of China
Zitieren
APA
Wang, Y., Wu, H., & Li, R. (2024). Deep Graph Reinforcement Learning for Mobile Edge Computing: Challenges and Solutions. IEEE Network, 38(5), 314-323. https://doi.org/10.1109/mnet.2024.3383242
Vancouver
Wang Y, Wu H, Li R. Deep Graph Reinforcement Learning for Mobile Edge Computing: Challenges and Solutions. IEEE Network. 2024;38(5):314-323. doi:10.1109/mnet.2024.3383242
BibTeX
@article{Wang2024,
author = {Wang, Yixiao and Wu, Huaming and Li, Ruidong},
title = {Deep Graph Reinforcement Learning for Mobile Edge Computing: Challenges and Solutions},
journal = {IEEE Network},
year = {2024},
volume = {38},
number = {5},
pages = {314--323},
doi = {10.1109/mnet.2024.3383242}
}
EUVIMED