EUVIMEDEUVIMED entdecken
Crossref

Self-Attention Proximal Policy Optimization for Beam Tracking in mmWave Communications

Xin Liu, Jie Tan, Xiaoguang Ren, Huadong Dai

IEEE Journal on Selected Areas in Communications · 2026 · 44 · 4552-4569

DOI: 10.1109/jsac.2026.3669465 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Journal on Selected Areas in Communications, 2026. Verfasst von Xin Liu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 73 Literaturangaben. Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Millimeter-wave (mmWave) communication systems are highly sensitive to user mobility and environmental changes, often suffering from rapid beam direction shifts and frequent link blockages. These dynamics pose significant challenges to maintaining reliable beam tracking. To enable accurate and robust beam tracking in dynamic environments, we propose a Self-Attention Proximal Policy Optimization (SAPPO) algorithm. The beam tracking task is modeled as a Partially Observable Markov Decision Process (POMDP), where the agent aims to maximize Received Signal Strength (RSS) using only current and previous signal observations, without relying on channel models or complex signal processing. By integrating a multi-head self-attention (MHSA) mechanism with a Gated Recurrent Unit (GRU), the policy network effectively captures temporal dependencies, enhancing the agent’s perception of user motion and channel state variations. To validate the approach, we construct three test scenarios with varying mobility and blockage complexity using the DeepMIMO dataset. Experimental results demonstrate that SAPPO consistently outperforms baseline methods such as DQN and PPO in terms of tracking accuracy, stability, and robustness. Notably, in challenging environments with frequent Line-Of-Sight (LOS)/Non-Line-Of-Sight (NLOS) transitions, SAPPO achieves a beam tracking success rate exceeding 95%, highlighting its strong adaptability and reliable performance under dynamic conditions.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Liu, X., Tan, J., Ren, X., & Dai, H. (2026). Self-Attention Proximal Policy Optimization for Beam Tracking in mmWave Communications. IEEE Journal on Selected Areas in Communications, 44, 4552-4569. https://doi.org/10.1109/jsac.2026.3669465

Vancouver

Liu X, Tan J, Ren X, Dai H. Self-Attention Proximal Policy Optimization for Beam Tracking in mmWave Communications. IEEE Journal on Selected Areas in Communications. 2026;44:4552-4569. doi:10.1109/jsac.2026.3669465

BibTeX
@article{Liu2026,
  author = {Liu, Xin and Tan, Jie and Ren, Xiaoguang and Dai, Huadong},
  title = {Self-Attention Proximal Policy Optimization for Beam Tracking in mmWave Communications},
  journal = {IEEE Journal on Selected Areas in Communications},
  year = {2026},
  volume = {44},
  pages = {4552--4569},
  doi = {10.1109/jsac.2026.3669465}
}
Kostenlos starten →