EUVIMEDEUVIMED entdecken
Crossref

Deep Reinforcement Learning Enables Joint Trajectory and Communication in Internet of Robotic Things

Ruyu Luo, Hui Tian, Wanli Ni, Julian Cheng, Kwang-Cheng Chen

IEEE Transactions on Wireless Communications · 2024-12 · 23 (12) · 18154-18168

DOI: 10.1109/twc.2024.3462450 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Wireless Communications, 2024-12. Verfasst von Ruyu Luo und 4 weiteren Autor:innen. Die Arbeit wurde bisher 21-mal zitiert (Crossref) und nennt 56 Literaturangaben. Gefördert von: National Natural Science Foundation of China, BUPT Excellent Ph.D. Students Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Internet of Robotic Things (IoRT) emphasizes the integrated robotic, artificial intelligence computing, and communication technologies, enabling more sophisticated operations and decision-making. As a crucial element of IoRT, mission-critical applications, such as industrial manufacturing and emergency services, impose stringent requirements on ultra-reliable and low-latency communication (URLLC). The paper focuses on addressing URLLC challenges in the context of IoRT, particularly when autonomous mobile robots (AMRs) coexist with static sensors. We prioritize safe and efficient AMRs’ travel through trajectory design and communication resource allocation in IoRT systems without the need of any prior knowledge. To enhance network connectivity and exploit diversity gains, we introduce the flexible decoding and free clustering as the next-generation multiple access technologies in spectrum-limited downlink IoRT system. Then, aiming at minimizing the decoding error probability and travel time, we formulate a long-term multi-objective optimization problem by jointly designing AMRs’ trajectory and communication resource. To accommodate the inherent dynamics and unpredictability in the IoRT system, we introduce a multi-agent actor-critic deep reinforcement learning (DRL) framework, offering four distinct implementations, each accompanied by comprehensive complexity analyses. Simulation results reveal the following insights: 1) in terms of DRL implementations, off-policy algorithms with deterministic policies outperform their on-policy counterparts, achieving approximately a 67% increase in rewards; 2) In terms of communication schemes, our proposed flexible decoding and free clustering strategies under designed trajectories can effectively reduce decoding errors; and 3) In terms of algorithm optimality, our DRL framework shows superior flexibility and adaptability in communication environments compared to traditional A* search and heuristic methods.

Förderung

  • National Natural Science Foundation of China
  • BUPT Excellent Ph.D. Students Foundation

Zitieren

APA

Luo, R., Tian, H., Ni, W., Cheng, J., & Chen, K. (2024). Deep Reinforcement Learning Enables Joint Trajectory and Communication in Internet of Robotic Things. IEEE Transactions on Wireless Communications, 23(12), 18154-18168. https://doi.org/10.1109/twc.2024.3462450

Vancouver

Luo R, Tian H, Ni W, Cheng J, Chen K. Deep Reinforcement Learning Enables Joint Trajectory and Communication in Internet of Robotic Things. IEEE Transactions on Wireless Communications. 2024;23(12):18154-18168. doi:10.1109/twc.2024.3462450

BibTeX
@article{Luo2024,
  author = {Luo, Ruyu and Tian, Hui and Ni, Wanli and Cheng, Julian and Chen, Kwang-Cheng},
  title = {Deep Reinforcement Learning Enables Joint Trajectory and Communication in Internet of Robotic Things},
  journal = {IEEE Transactions on Wireless Communications},
  year = {2024},
  volume = {23},
  number = {12},
  pages = {18154--18168},
  doi = {10.1109/twc.2024.3462450}
}
Kostenlos starten →