EUVIMEDEUVIMED entdecken
Crossref

Deep-Reinforcement-Learning-Based Joint Caching and Resources Allocation for Cooperative MEC

Wenqian Zhang, Guanglin Zhang, Shiwen Mao

IEEE Internet of Things Journal · 01.04.2024 · 11 (7) · 12203-12215

DOI: 10.1109/jiot.2023.3333826 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Internet of Things Journal, erschienen am 01.04.2024. Verfasst von Wenqian Zhang und 2 weiteren Autor:innen. Die Arbeit wurde bisher 64-mal zitiert (Crossref) und nennt 40 Literaturangaben. Gefördert von: National Natural Science Foundation of China, International S&T Cooperation Program of Shanghai Science and Technology Commission, Program for Professor of Special Appointment (Eastern Scholar) at Shanghai Institutions of Higher Learning.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The emergence of new applications has led to a high demand for mobile-edge computing (MEC), which is a promising paradigm with a cloud-like architecture deployed at the network edge to provide computation and storage services to mobile users (MUs). Since MEC servers have limited resources compared to the remote cloud, it is crucial to optimize resource allocation in MEC systems and balance the load among cooperating MEC servers. Caching application data for different types of computing services (CSs) at MEC servers can also be highly beneficial. In this article, we investigate the problem of hierarchical joint caching and resource allocation in a cooperative MEC system, which is formulated as an infinite-horizon cost minimization Markov decision process (MDP). To deal with the large state and action spaces, we decompose the problem into two coupled subproblems and develop a hierarchical reinforcement learning (HRL)-based solution. The lower layer uses the deep $Q$ network (DQN) to obtain service caching and workload offloading decisions, while the upper layer leverages DQN to obtain load balancing decisions among cooperative MEC servers. The feasibility and effectiveness of our proposed schemes are validated by our evaluation results.

Förderung

  • National Natural Science Foundation of China
  • International S&T Cooperation Program of Shanghai Science and Technology Commission
  • Program for Professor of Special Appointment (Eastern Scholar) at Shanghai Institutions of Higher Learning
  • “Shuguang Program” of Shanghai Education Development Foundation and Shanghai Municipal Education Commission
  • Young Top-Notch Talent Program in Shanghai

Zitieren

APA

Zhang, W., Zhang, G., & Mao, S. (2024). Deep-Reinforcement-Learning-Based Joint Caching and Resources Allocation for Cooperative MEC. IEEE Internet of Things Journal, 11(7), 12203-12215. https://doi.org/10.1109/jiot.2023.3333826

Vancouver

Zhang W, Zhang G, Mao S. Deep-Reinforcement-Learning-Based Joint Caching and Resources Allocation for Cooperative MEC. IEEE Internet of Things Journal. 2024;11(7):12203-12215. doi:10.1109/jiot.2023.3333826

BibTeX
@article{Zhang2024,
  author = {Zhang, Wenqian and Zhang, Guanglin and Mao, Shiwen},
  title = {Deep-Reinforcement-Learning-Based Joint Caching and Resources Allocation for Cooperative MEC},
  journal = {IEEE Internet of Things Journal},
  year = {2024},
  volume = {11},
  number = {7},
  pages = {12203--12215},
  doi = {10.1109/jiot.2023.3333826}
}
Kostenlos starten →