Multi-Agent Deep Reinforcement Learning Based Resource Allocation for Ultra-Reliable Low-Latency Internet of Controllable Things
IEEE Transactions on Wireless Communications · 2023-08 · 22 (8) · 5414-5430
DOI: 10.1109/twc.2022.3233853 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Wireless Communications, 2023-08. Verfasst von Yang Xiao und 2 weiteren Autor:innen. Die Arbeit wurde bisher 61-mal zitiert (Crossref) und nennt 47 Literaturangaben. Gefördert von: Ministry of Education-China Mobile Communications Group Co., Ltd (MoE-CMCC) Artificial Intelligence Project, Beijing University of Posts and Telecommunications Excellent Ph.D. Students Foundation.
Abstract (Originalsprache)
As a promising technology in the 5G era, the artificial intelligence (AI) enabled Internet of controllable things (IoCT) is expected to be an integral part of heterogeneous networks (HetNets) in the future. However, the realization of ultra-reliable low-latency communications (URLLC) in IoCT communications underlaid HetNet has stringent quality of service (QoS) requirements, resulting in unprecedented challenges for existing wireless resource allocation methods. In this paper, we first describe a cellular HetNet model with uplink IoCT communications, then formulate a dynamic mixed-integer nonlinear programming (MINLP) resource allocation problem for maximizing the long-term average energy efficiency under URLLC requirements including reliability, latency, and transmission rate. To solve the problem, we propose a decentralized MADRL-based resource allocation algorithm with a decentralized partially observable Markov decision process (dec-POMDP) and a mixed-centralized-decentralized (MCD) framework to address the partial observability and the scalability issues, respectively. In addition, we design a reward function featuring the objective decomposition, baseline-guided scaling, and QoS violation penalty so that the agents are coordinated. Extensive experiments demonstrate the convergence, scalability, and robustness of the proposed algorithm. Besides, the proposed algorithm substantially outperforms conventional resource allocation methods and different agent communication mechanisms in terms of maximizing energy efficiency.
Förderung
- Ministry of Education-China Mobile Communications Group Co., Ltd (MoE-CMCC) Artificial Intelligence Project
- Beijing University of Posts and Telecommunications Excellent Ph.D. Students Foundation
Zitieren
APA
Xiao, Y., Song, Y., & Liu, J. (2023). Multi-Agent Deep Reinforcement Learning Based Resource Allocation for Ultra-Reliable Low-Latency Internet of Controllable Things. IEEE Transactions on Wireless Communications, 22(8), 5414-5430. https://doi.org/10.1109/twc.2022.3233853
Vancouver
Xiao Y, Song Y, Liu J. Multi-Agent Deep Reinforcement Learning Based Resource Allocation for Ultra-Reliable Low-Latency Internet of Controllable Things. IEEE Transactions on Wireless Communications. 2023;22(8):5414-5430. doi:10.1109/twc.2022.3233853
BibTeX
@article{Xiao2023,
author = {Xiao, Yang and Song, Yuqian and Liu, Jun},
title = {Multi-Agent Deep Reinforcement Learning Based Resource Allocation for Ultra-Reliable Low-Latency Internet of Controllable Things},
journal = {IEEE Transactions on Wireless Communications},
year = {2023},
volume = {22},
number = {8},
pages = {5414--5430},
doi = {10.1109/twc.2022.3233853}
}
EUVIMED