EUVIMEDEUVIMED entdecken
Crossref

Semi-Distributed Reinforcement Learning for Internet of Robotic Things-Based Sustainable Data Collection

Ruyu Luo, Hui Tian, Wanli Ni, Hao Luo, Julian Cheng, Tony Q. S. Quek

IEEE Transactions on Wireless Communications · 2026 · 25 · 16645-16662

DOI: 10.1109/twc.2026.3689543 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Wireless Communications, 2026. Verfasst von Ruyu Luo und 5 weiteren Autor:innen. Die Arbeit nennt 39 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Beijing University of Posts and Telecommunications (BUPT) Excellent Ph.D. Students Foundation, National Research Foundation, Singapore, and Infocomm Media Development Authority under its Communications and Connectivity Bridging Funding Initiative.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper studies the problem of long-term, high-quality data collection in dynamic industrial environments using autonomous mobile robots (AMRs). We formulate a max–min data-rate optimization problem that jointly designs AMR trajectories, receive beamforming, sensor association, and decoding policy under mobility, communication, and battery constraints. The problem is challenging because motion decisions directly influence link quality, which affects decoding and beamforming efficiency, while all of these factors are tightly coupled with battery dynamics, resulting in a mixed-integer, time-varying, and non-convex design. To handle this strong coupling and the need for scalable long-horizon decision-making, we propose a semi-distributed reinforcement learning framework that combines cloud-level global coordination with fog-level local adaptability. In this framework, a cloud-layer deep Q-network determines AMR-sensor associations, and a fog-layer federated actor-critic algorithm jointly designs continuous trajectories and beamforming. A Fubini–Study distance-assisted k-means clustering method enhances multi-antenna directional gains, and next-generation multiple access (NGMA) improves spectral efficiency and interference suppression. Theoretical analysis confirms the convergence and computational efficiency of the proposed algorithm. Simulations show that the proposed approach achieves faster and more stable convergence, sustains large-scale coverage through periodic recharging, and significantly improves the minimum data rate compared with orthogonal multiple access-based baselines.

Förderung

  • National Natural Science Foundation of China
  • Beijing University of Posts and Telecommunications (BUPT) Excellent Ph.D. Students Foundation
  • National Research Foundation, Singapore, and Infocomm Media Development Authority under its Communications and Connectivity Bridging Funding Initiative

Zitieren

APA

Luo, R., Tian, H., Ni, W., Luo, H., Cheng, J., & Quek, T. Q. S. (2026). Semi-Distributed Reinforcement Learning for Internet of Robotic Things-Based Sustainable Data Collection. IEEE Transactions on Wireless Communications, 25, 16645-16662. https://doi.org/10.1109/twc.2026.3689543

Vancouver

Luo R, Tian H, Ni W, Luo H, Cheng J, Quek TQS. Semi-Distributed Reinforcement Learning for Internet of Robotic Things-Based Sustainable Data Collection. IEEE Transactions on Wireless Communications. 2026;25:16645-16662. doi:10.1109/twc.2026.3689543

BibTeX
@article{Luo2026,
  author = {Luo, Ruyu and Tian, Hui and Ni, Wanli and Luo, Hao and Cheng, Julian and Quek, Tony Q. S.},
  title = {Semi-Distributed Reinforcement Learning for Internet of Robotic Things-Based Sustainable Data Collection},
  journal = {IEEE Transactions on Wireless Communications},
  year = {2026},
  volume = {25},
  pages = {16645--16662},
  doi = {10.1109/twc.2026.3689543}
}
Kostenlos starten →