EUVIMEDEUVIMED entdecken
Crossref

DQN-ALrM-Based Intelligent Handover Method for Satellite-Ground Integrated Network

Junyi Yang, Zhenyu Xiao, Huanxi Cui, Jingjing Zhao, Guowei Jiang, Zhu Han

IEEE Transactions on Cognitive Communications and Networking · 2023-08 · 9 (4) · 977-990

DOI: 10.1109/tccn.2023.3262239 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Cognitive Communications and Networking, 2023-08. Verfasst von Junyi Yang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 56-mal zitiert (Crossref) und nennt 39 Literaturangaben. Gefördert von: Beijing Natural Science Foundation, National Natural Science Foundation of China, NSF.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The satellite-ground integrated network (SGIN), consisting of satellites and ground base stations, is regarded as the trend to solve the problem of global coverage. However, highly dynamic scenarios pose great challenges to users’ mobility management, especially handover decisions. With the rapid development of machine learning, reinforcement learning (RL), such as Q-learning and deep Q-network (DQN), has been applied to handover decision making owing to being good at solving dynamic multi-attribute optimization problems. However, Q-learning can be a waste of storage for large state spaces. Besides, the existing algorithms for training a neural network in a deep RL framework have problems of slow convergence or unstable convergence performance. Therefore, we propose a handover method exploiting the DQN framework of adaptive learning rate with momentum (DQN-ALrM), which can not only improve decision accuracy, but also improve learning efficiency. The customized DQN framework can solve problems with a large-size state space, and the proposed ALrM method can adjust the learning rate at any time according to the training error situation. Comprehensive simulations are conducted to validate the superiority of the proposed method in convergence speed, handover rate, call failure rate and multi-metric quality of service (QoS) over the alternative solutions in the literature.

Förderung

  • Beijing Natural Science Foundation
  • National Natural Science Foundation of China
  • NSF
  • Toyota and Amazon

Zitieren

APA

Yang, J., Xiao, Z., Cui, H., Zhao, J., Jiang, G., & Han, Z. (2023). DQN-ALrM-Based Intelligent Handover Method for Satellite-Ground Integrated Network. IEEE Transactions on Cognitive Communications and Networking, 9(4), 977-990. https://doi.org/10.1109/tccn.2023.3262239

Vancouver

Yang J, Xiao Z, Cui H, Zhao J, Jiang G, Han Z. DQN-ALrM-Based Intelligent Handover Method for Satellite-Ground Integrated Network. IEEE Transactions on Cognitive Communications and Networking. 2023;9(4):977-990. doi:10.1109/tccn.2023.3262239

BibTeX
@article{Yang2023,
  author = {Yang, Junyi and Xiao, Zhenyu and Cui, Huanxi and Zhao, Jingjing and Jiang, Guowei and Han, Zhu},
  title = {DQN-ALrM-Based Intelligent Handover Method for Satellite-Ground Integrated Network},
  journal = {IEEE Transactions on Cognitive Communications and Networking},
  year = {2023},
  volume = {9},
  number = {4},
  pages = {977--990},
  doi = {10.1109/tccn.2023.3262239}
}
Kostenlos starten →