EUVIMEDEUVIMED entdecken
Crossref

Deep Reinforcement Learning Based Dynamic Beam Selection in Dual-Band Communication Systems

Zhen Zhang, Jianhua Zhang, Yuxiang Zhang, Li Yu, Feifei Gao, Qingjiang Shi, Guangyi Liu, Zhiqiang Yuan, Wei Fan

IEEE Transactions on Wireless Communications · 2024-04 · 23 (4) · 2591-2606

DOI: 10.1109/twc.2023.3300830 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Wireless Communications, 2024-04. Verfasst von Zhen Zhang und 8 weiteren Autor:innen. Die Arbeit wurde bisher 33-mal zitiert (Crossref) und nennt 40 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Beijing University of Posts and Telecommunications–China Mobile Research Institute Joint Innovation Center.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

To reduce the downlink beam sweep overhead of mmWave systems, we propose a deep reinforcement learning based dynamic beam selection (DRL-DBS) method. A new learning motivation is presented by analyzing the dynamic change laws of high- and low-frequency channels in the spatial domain: to learn the index offset between the optimal beam of mmWave and sub-6 GHz spatial spectrum. In the DRL-DBS method, we propose a novel action space where actions can dynamically adjust the size of the beam sweep subset according to the high- and low-frequency channel propagation laws. Hence, the DRL-DBS method can predict a mmWave downlink beam sweep subset with dynamic size, and the optimal beamforming index is from beam sweep results on the subset. A dual-input dueling Q-network with noisy networks and prioritized experience replay is designed to select the optimal action. The DRL-DBS method can achieve a dynamic trade-off between mmWave beam selection quality and beam sweep overhead based on the reward function. Simulation results demonstrate the superior performance of the DRL-DBS method compared with the existing strategies. Especially, the DRL-DBS method outperforms the exhaustive search algorithm in achievable rate because the overhead of mmWave beam sweep is considered.

Förderung

  • National Natural Science Foundation of China
  • Beijing University of Posts and Telecommunications–China Mobile Research Institute Joint Innovation Center

Zitieren

APA

Zhang, Z., Zhang, J., Zhang, Y., Yu, L., Gao, F., Shi, Q., Liu, G., Yuan, Z., & Fan, W. (2024). Deep Reinforcement Learning Based Dynamic Beam Selection in Dual-Band Communication Systems. IEEE Transactions on Wireless Communications, 23(4), 2591-2606. https://doi.org/10.1109/twc.2023.3300830

Vancouver

Zhang Z, Zhang J, Zhang Y, Yu L, Gao F, Shi Q, et al. Deep Reinforcement Learning Based Dynamic Beam Selection in Dual-Band Communication Systems. IEEE Transactions on Wireless Communications. 2024;23(4):2591-2606. doi:10.1109/twc.2023.3300830

BibTeX
@article{Zhang2024,
  author = {Zhang, Zhen and Zhang, Jianhua and Zhang, Yuxiang and Yu, Li and Gao, Feifei and Shi, Qingjiang and Liu, Guangyi and Yuan, Zhiqiang and Fan, Wei},
  title = {Deep Reinforcement Learning Based Dynamic Beam Selection in Dual-Band Communication Systems},
  journal = {IEEE Transactions on Wireless Communications},
  year = {2024},
  volume = {23},
  number = {4},
  pages = {2591--2606},
  doi = {10.1109/twc.2023.3300830}
}
Kostenlos starten →