EUVIMEDEUVIMED entdecken
Crossref

Multi-Agent Deep Reinforcement Learning Based Resource Allocation for Ultra-Reliable Low-Latency Internet of Controllable Things

Yang Xiao, Yuqian Song, Jun Liu

IEEE Transactions on Wireless Communications · 2023-08 · 22 (8) · 5414-5430

DOI: 10.1109/twc.2022.3233853 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Wireless Communications, 2023-08. Verfasst von Yang Xiao und 2 weiteren Autor:innen. Die Arbeit wurde bisher 61-mal zitiert (Crossref) und nennt 47 Literaturangaben. Gefördert von: Ministry of Education-China Mobile Communications Group Co., Ltd (MoE-CMCC) Artificial Intelligence Project, Beijing University of Posts and Telecommunications Excellent Ph.D. Students Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

As a promising technology in the 5G era, the artificial intelligence (AI) enabled Internet of controllable things (IoCT) is expected to be an integral part of heterogeneous networks (HetNets) in the future. However, the realization of ultra-reliable low-latency communications (URLLC) in IoCT communications underlaid HetNet has stringent quality of service (QoS) requirements, resulting in unprecedented challenges for existing wireless resource allocation methods. In this paper, we first describe a cellular HetNet model with uplink IoCT communications, then formulate a dynamic mixed-integer nonlinear programming (MINLP) resource allocation problem for maximizing the long-term average energy efficiency under URLLC requirements including reliability, latency, and transmission rate. To solve the problem, we propose a decentralized MADRL-based resource allocation algorithm with a decentralized partially observable Markov decision process (dec-POMDP) and a mixed-centralized-decentralized (MCD) framework to address the partial observability and the scalability issues, respectively. In addition, we design a reward function featuring the objective decomposition, baseline-guided scaling, and QoS violation penalty so that the agents are coordinated. Extensive experiments demonstrate the convergence, scalability, and robustness of the proposed algorithm. Besides, the proposed algorithm substantially outperforms conventional resource allocation methods and different agent communication mechanisms in terms of maximizing energy efficiency.

Förderung

  • Ministry of Education-China Mobile Communications Group Co., Ltd (MoE-CMCC) Artificial Intelligence Project
  • Beijing University of Posts and Telecommunications Excellent Ph.D. Students Foundation

Zitieren

APA

Xiao, Y., Song, Y., & Liu, J. (2023). Multi-Agent Deep Reinforcement Learning Based Resource Allocation for Ultra-Reliable Low-Latency Internet of Controllable Things. IEEE Transactions on Wireless Communications, 22(8), 5414-5430. https://doi.org/10.1109/twc.2022.3233853

Vancouver

Xiao Y, Song Y, Liu J. Multi-Agent Deep Reinforcement Learning Based Resource Allocation for Ultra-Reliable Low-Latency Internet of Controllable Things. IEEE Transactions on Wireless Communications. 2023;22(8):5414-5430. doi:10.1109/twc.2022.3233853

BibTeX
@article{Xiao2023,
  author = {Xiao, Yang and Song, Yuqian and Liu, Jun},
  title = {Multi-Agent Deep Reinforcement Learning Based Resource Allocation for Ultra-Reliable Low-Latency Internet of Controllable Things},
  journal = {IEEE Transactions on Wireless Communications},
  year = {2023},
  volume = {22},
  number = {8},
  pages = {5414--5430},
  doi = {10.1109/twc.2022.3233853}
}
Kostenlos starten →