EUVIMEDEUVIMED entdecken
Crossref

IRS Assisted NOMA Aided Mobile Edge Computing With Queue Stability: Heterogeneous Multi-Agent Reinforcement Learning

Jiadong Yu, Yang Li, Xiaolan Liu, Bo Sun, Yuan Wu, Danny Hin-Kwok Tsang

IEEE Transactions on Wireless Communications · 2023-07 · 22 (7) · 4296-4312

DOI: 10.1109/twc.2022.3224291 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Wireless Communications, 2023-07. Verfasst von Jiadong Yu und 5 weiteren Autor:innen. Die Arbeit wurde bisher 74-mal zitiert (Crossref) und nennt 46 Literaturangaben. Gefördert von: Foshan-The Hong Kong University of Science and Technology, Science and Technology Development Fund of Macau SAR, Basic and Applied Basic Research Foundation of Guangdong Province.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

By employing powerful edge servers for data processing, mobile edge computing (MEC) has been recognized as a promising technology to support emerging computation-intensive applications. Besides, non-orthogonal multiple access (NOMA)-aided MEC system can further enhance the spectral efficiency with massive tasks offloading. However, with more dynamic devices brought online and the uncontrollable stochastic channel environment, it is even desirable to deploy appealing technique, i.e., intelligent reflecting surfaces (IRS), in the MEC system to flexibly tune the communication environment and improve the system energy efficiency. In this paper, we investigate the joint offloading, communication and computation resource allocation for the IRS-assisted NOMA MEC system. We first formulate a mixed integer energy efficiency maximization problem with system queue stability constraint. We then propose the Lyapunov-function-based Mixed Integer Deep Deterministic Policy Gradient (LMIDDPG) algorithm which is based on the centralized reinforcement learning (RL) framework. To be specific, we design the mixed integer action space mapping which contains both continuous mapping and integer mapping. Moreover, the award function is defined as the upper-bound of the Lyapunov drift-plus-penalty function. To enable end devices (EDs) to choose actions independently at the execution stage, we further propose the Heterogeneous Multi-agent LMIDDPG (HMA-LMIDDPG) algorithm based on distributed RL framework with homogeneous EDs and heterogeneous base station (BS) as heterogeneous multi-agent. Numerical results show that our proposed algorithms can achieve superior energy efficiency performance to the benchmark algorithms while maintaining the queue stability. Specially, the distributed structure HMA-LMIDDPG can acquire more energy efficiency gain than the centralized structure LMIDDPG.

Förderung

  • Foshan-The Hong Kong University of Science and Technology
  • Science and Technology Development Fund of Macau SAR
  • Basic and Applied Basic Research Foundation of Guangdong Province
  • Guangdong—Macau Joint Laboratory for Advanced and Intelligent Computing

Zitieren

APA

Yu, J., Li, Y., Liu, X., Sun, B., Wu, Y., & Tsang, D. H. (2023). IRS Assisted NOMA Aided Mobile Edge Computing With Queue Stability: Heterogeneous Multi-Agent Reinforcement Learning. IEEE Transactions on Wireless Communications, 22(7), 4296-4312. https://doi.org/10.1109/twc.2022.3224291

Vancouver

Yu J, Li Y, Liu X, Sun B, Wu Y, Tsang DH. IRS Assisted NOMA Aided Mobile Edge Computing With Queue Stability: Heterogeneous Multi-Agent Reinforcement Learning. IEEE Transactions on Wireless Communications. 2023;22(7):4296-4312. doi:10.1109/twc.2022.3224291

BibTeX
@article{Yu2023,
  author = {Yu, Jiadong and Li, Yang and Liu, Xiaolan and Sun, Bo and Wu, Yuan and Tsang, Danny Hin-Kwok},
  title = {IRS Assisted NOMA Aided Mobile Edge Computing With Queue Stability: Heterogeneous Multi-Agent Reinforcement Learning},
  journal = {IEEE Transactions on Wireless Communications},
  year = {2023},
  volume = {22},
  number = {7},
  pages = {4296--4312},
  doi = {10.1109/twc.2022.3224291}
}
Kostenlos starten →