Self-Attention Proximal Policy Optimization for Beam Tracking in mmWave Communications
IEEE Journal on Selected Areas in Communications · 2026 · 44 · 4552-4569
DOI: 10.1109/jsac.2026.3669465 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Journal on Selected Areas in Communications, 2026. Verfasst von Xin Liu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 73 Literaturangaben. Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
Millimeter-wave (mmWave) communication systems are highly sensitive to user mobility and environmental changes, often suffering from rapid beam direction shifts and frequent link blockages. These dynamics pose significant challenges to maintaining reliable beam tracking. To enable accurate and robust beam tracking in dynamic environments, we propose a Self-Attention Proximal Policy Optimization (SAPPO) algorithm. The beam tracking task is modeled as a Partially Observable Markov Decision Process (POMDP), where the agent aims to maximize Received Signal Strength (RSS) using only current and previous signal observations, without relying on channel models or complex signal processing. By integrating a multi-head self-attention (MHSA) mechanism with a Gated Recurrent Unit (GRU), the policy network effectively captures temporal dependencies, enhancing the agent’s perception of user motion and channel state variations. To validate the approach, we construct three test scenarios with varying mobility and blockage complexity using the DeepMIMO dataset. Experimental results demonstrate that SAPPO consistently outperforms baseline methods such as DQN and PPO in terms of tracking accuracy, stability, and robustness. Notably, in challenging environments with frequent Line-Of-Sight (LOS)/Non-Line-Of-Sight (NLOS) transitions, SAPPO achieves a beam tracking success rate exceeding 95%, highlighting its strong adaptability and reliable performance under dynamic conditions.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Liu, X., Tan, J., Ren, X., & Dai, H. (2026). Self-Attention Proximal Policy Optimization for Beam Tracking in mmWave Communications. IEEE Journal on Selected Areas in Communications, 44, 4552-4569. https://doi.org/10.1109/jsac.2026.3669465
Vancouver
Liu X, Tan J, Ren X, Dai H. Self-Attention Proximal Policy Optimization for Beam Tracking in mmWave Communications. IEEE Journal on Selected Areas in Communications. 2026;44:4552-4569. doi:10.1109/jsac.2026.3669465
BibTeX
@article{Liu2026,
author = {Liu, Xin and Tan, Jie and Ren, Xiaoguang and Dai, Huadong},
title = {Self-Attention Proximal Policy Optimization for Beam Tracking in mmWave Communications},
journal = {IEEE Journal on Selected Areas in Communications},
year = {2026},
volume = {44},
pages = {4552--4569},
doi = {10.1109/jsac.2026.3669465}
}
EUVIMED