Deep Reinforcement Learning for Dynamic Spectrum Access: Convergence Analysis and System Design
IEEE Transactions on Wireless Communications · 2024-12 · 23 (12) · 18888-18902
DOI: 10.1109/twc.2024.3414428 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Wireless Communications, 2024-12. Verfasst von Ramin Safavinejad und 2 weiteren Autor:innen. Die Arbeit wurde bisher 28-mal zitiert (Crossref) und nennt 46 Literaturangaben. Gefördert von: U.S. National Science Foundation.
Abstract (Originalsprache)
In dynamic spectrum access (DSA) networks, secondary users (SUs) need to opportunistically access primary users’ (PUs) radio spectrum without causing significant interference. Since the SU-PU interaction is limited, deep reinforcement learning has been introduced to help SUs conduct spectrum access. Specifically, deep recurrent Q network (DRQN) has been utilized in DSA networks for SUs to aggregate information from recent experiences to make spectrum access decisions. DRQN is notorious for its sample efficiency since it needs a rather large number of training samples to tune its parameters which is a computationally demanding task. Deep echo state network (DEQN) has been introduced for DSA networks to address the sample efficiency issue of DRQN. In this work, we compare the convergence of DRQN and DEQN by comparing the upper bounds we obtain on their covering number, a notion of richness. Furthermore, we introduce a method to determine the right hyper-parameters for DEQN, providing system design guidance for DEQN-based DSA networks. Extensive performance evaluation confirms that DEQN-based DSA strategy is the superior choice with regard to computational power while outperforming DRQN-based ones.
Förderung
- U.S. National Science Foundation
Zitieren
APA
Safavinejad, R., Chang, H., & Liu, L. (2024). Deep Reinforcement Learning for Dynamic Spectrum Access: Convergence Analysis and System Design. IEEE Transactions on Wireless Communications, 23(12), 18888-18902. https://doi.org/10.1109/twc.2024.3414428
Vancouver
Safavinejad R, Chang H, Liu L. Deep Reinforcement Learning for Dynamic Spectrum Access: Convergence Analysis and System Design. IEEE Transactions on Wireless Communications. 2024;23(12):18888-18902. doi:10.1109/twc.2024.3414428
BibTeX
@article{Safavinejad2024,
author = {Safavinejad, Ramin and Chang, Hao-Hsuan and Liu, Lingjia},
title = {Deep Reinforcement Learning for Dynamic Spectrum Access: Convergence Analysis and System Design},
journal = {IEEE Transactions on Wireless Communications},
year = {2024},
volume = {23},
number = {12},
pages = {18888--18902},
doi = {10.1109/twc.2024.3414428}
}
EUVIMED