EUVIMEDEUVIMED entdecken
Crossref

A Heterogeneous Multiagent Reinforcement Learning Approach for Robust Uplink Beamforming in Maritime Satellite Communications

Huayuan Wang, Bodong Shang, Meixia Tao

IEEE Transactions on Aerospace and Electronic Systems · 2026 · 62 · 14229-14243

DOI: 10.1109/taes.2026.3715439 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Aerospace and Electronic Systems, 2026. Verfasst von Huayuan Wang und 2 weiteren Autor:innen. Die Arbeit nennt 34 Literaturangaben. Gefördert von: Natural Science Foundation of Ningbo Municipality, State Key Laboratory of Integrated Services Networks, Xidian University.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Maritime satellite communications (SATCOMs) are expected to support high-capacity ship-to-satellite uplinks for remote maritime services beyond terrestrial coverage, with low-Earth-orbit (LEO) satellites providing wide-area connectivity. However, robust uplink beamforming in LEO maritime SATCOMs is challenging because dynamic ship–satellite geometry, wave-induced attitude motion, imperfect channel state information, and multiship interference make transmit power, ship-side transmit beamforming, and satellite-side receive combining tightly coupled. Accordingly, we formulate a long-term spectral efficiency (SE) maximization problem under transmit-power and quality-of-service constraints. An attitude-aware uplink channel model is developed by incorporating roll, pitch, and yaw motions into the effective angle-of-departure/angle-of-arrival evolution. Based on this model, the problem is cast as a heterogeneous decentralized partially observable Markov decision process. We then propose a robust heterogeneous cooperative QMIX (RHC-QMIX) framework under centralized training and decentralized execution, where type-specific recurrent local Q-networks, history-refined angular features, and centralized monotonic value mixing coordinate ship and satellite agents. Extensive simulations demonstrate that in the load-controlled scalability evaluation, RHC-QMIX achieves an average network SE of 25.32 bps/Hz, improves over alternating optimization by up to 51.00% as the satellite load increases, and outperforms heterogeneous cooperative QMIX by 16.38% on average under network-size scaling; it also maintains more stable SE under severe sea-state-induced ship motion.

Förderung

  • Natural Science Foundation of Ningbo Municipality
  • State Key Laboratory of Integrated Services Networks
  • Xidian University
  • Open Research Fund of National Mobile Communications Research Laboratory
  • Southeast University
  • National Natural Science Foundation of China

Zitieren

APA

Wang, H., Shang, B., & Tao, M. (2026). A Heterogeneous Multiagent Reinforcement Learning Approach for Robust Uplink Beamforming in Maritime Satellite Communications. IEEE Transactions on Aerospace and Electronic Systems, 62, 14229-14243. https://doi.org/10.1109/taes.2026.3715439

Vancouver

Wang H, Shang B, Tao M. A Heterogeneous Multiagent Reinforcement Learning Approach for Robust Uplink Beamforming in Maritime Satellite Communications. IEEE Transactions on Aerospace and Electronic Systems. 2026;62:14229-14243. doi:10.1109/taes.2026.3715439

BibTeX
@article{Wang2026,
  author = {Wang, Huayuan and Shang, Bodong and Tao, Meixia},
  title = {A Heterogeneous Multiagent Reinforcement Learning Approach for Robust Uplink Beamforming in Maritime Satellite Communications},
  journal = {IEEE Transactions on Aerospace and Electronic Systems},
  year = {2026},
  volume = {62},
  pages = {14229--14243},
  doi = {10.1109/taes.2026.3715439}
}
Kostenlos starten →