DQN-ALrM-Based Intelligent Handover Method for Satellite-Ground Integrated Network
IEEE Transactions on Cognitive Communications and Networking · 2023-08 · 9 (4) · 977-990
DOI: 10.1109/tccn.2023.3262239 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Cognitive Communications and Networking, 2023-08. Verfasst von Junyi Yang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 56-mal zitiert (Crossref) und nennt 39 Literaturangaben. Gefördert von: Beijing Natural Science Foundation, National Natural Science Foundation of China, NSF.
Themen: Übergabe
Abstract (Originalsprache)
The satellite-ground integrated network (SGIN), consisting of satellites and ground base stations, is regarded as the trend to solve the problem of global coverage. However, highly dynamic scenarios pose great challenges to users’ mobility management, especially handover decisions. With the rapid development of machine learning, reinforcement learning (RL), such as Q-learning and deep Q-network (DQN), has been applied to handover decision making owing to being good at solving dynamic multi-attribute optimization problems. However, Q-learning can be a waste of storage for large state spaces. Besides, the existing algorithms for training a neural network in a deep RL framework have problems of slow convergence or unstable convergence performance. Therefore, we propose a handover method exploiting the DQN framework of adaptive learning rate with momentum (DQN-ALrM), which can not only improve decision accuracy, but also improve learning efficiency. The customized DQN framework can solve problems with a large-size state space, and the proposed ALrM method can adjust the learning rate at any time according to the training error situation. Comprehensive simulations are conducted to validate the superiority of the proposed method in convergence speed, handover rate, call failure rate and multi-metric quality of service (QoS) over the alternative solutions in the literature.
Förderung
- Beijing Natural Science Foundation
- National Natural Science Foundation of China
- NSF
- Toyota and Amazon
Zitieren
APA
Yang, J., Xiao, Z., Cui, H., Zhao, J., Jiang, G., & Han, Z. (2023). DQN-ALrM-Based Intelligent Handover Method for Satellite-Ground Integrated Network. IEEE Transactions on Cognitive Communications and Networking, 9(4), 977-990. https://doi.org/10.1109/tccn.2023.3262239
Vancouver
Yang J, Xiao Z, Cui H, Zhao J, Jiang G, Han Z. DQN-ALrM-Based Intelligent Handover Method for Satellite-Ground Integrated Network. IEEE Transactions on Cognitive Communications and Networking. 2023;9(4):977-990. doi:10.1109/tccn.2023.3262239
BibTeX
@article{Yang2023,
author = {Yang, Junyi and Xiao, Zhenyu and Cui, Huanxi and Zhao, Jingjing and Jiang, Guowei and Han, Zhu},
title = {DQN-ALrM-Based Intelligent Handover Method for Satellite-Ground Integrated Network},
journal = {IEEE Transactions on Cognitive Communications and Networking},
year = {2023},
volume = {9},
number = {4},
pages = {977--990},
doi = {10.1109/tccn.2023.3262239}
}
EUVIMED