Hierarchical Reinforcement Learning-Based Routing Algorithm With Grouped RSU in Urban VANETs
IEEE Transactions on Intelligent Transportation Systems · 2024-08 · 25 (8) · 10131-10146
DOI: 10.1109/tits.2024.3353258 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Intelligent Transportation Systems, 2024-08. Verfasst von Qin Yang und 1 weiteren Autor:innen. Die Arbeit wurde bisher 22-mal zitiert (Crossref) und nennt 46 Literaturangaben. Gefördert von: Ministry of Science and ICT (MSIT), South Korea, through the Information Technology Research Center, Institute for Information & Communications Technology Planning & Evaluation.
Abstract (Originalsprache)
The rapid growth of the Internet of Vehicles (IoV) has generated significant interest in routing techniques for vehicular ad hoc networks (VANETs) in both academic and industrial communities. To address the complexity of urban environments and dynamic vehicle mobility, we propose a hierarchical Q-learning-based routing algorithm with grouped roadside unit (RSU) for VANETs. RSUs are grouped, and a Q-vector containing group information is exchanged through vehicle-to-everything (V2X) communications. Q-vector-based road-segment (QVRS) control messages are periodically broadcasted to refresh the V2X evaluation metric, which considers vehicle positions, velocities, directions, and communication conditions. To adapt to the nonstationary vehicular environment, a multi-agent reinforcement learning (RL) algorithm is performed on RSUs at each intersection to achieve distributed learning and local decisions. The hierarchical Q-learning algorithm trains group Q-table and local Q-table individually for reaching destinations on each RSU. The optimal data routing behavior is conducted with two separate Q-tables by utilizing the integrated V2X metric as the reward function. Simulation results demonstrate that our proposed method reduces broadcasting overhead, prolongs path lifetime and maintains a high packet delivery ratio and low average end-to-end delay. The incorporation of group design in our method accelerates the learning process, which facilitates more efficient communication in VANETs.
Förderung
- Ministry of Science and ICT (MSIT), South Korea, through the Information Technology Research Center
- Institute for Information & Communications Technology Planning & Evaluation
Zitieren
APA
Yang, Q., & Yoo, S. (2024). Hierarchical Reinforcement Learning-Based Routing Algorithm With Grouped RSU in Urban VANETs. IEEE Transactions on Intelligent Transportation Systems, 25(8), 10131-10146. https://doi.org/10.1109/tits.2024.3353258
Vancouver
Yang Q, Yoo S. Hierarchical Reinforcement Learning-Based Routing Algorithm With Grouped RSU in Urban VANETs. IEEE Transactions on Intelligent Transportation Systems. 2024;25(8):10131-10146. doi:10.1109/tits.2024.3353258
BibTeX
@article{Yang2024,
author = {Yang, Qin and Yoo, Sang-Jo},
title = {Hierarchical Reinforcement Learning-Based Routing Algorithm With Grouped RSU in Urban VANETs},
journal = {IEEE Transactions on Intelligent Transportation Systems},
year = {2024},
volume = {25},
number = {8},
pages = {10131--10146},
doi = {10.1109/tits.2024.3353258}
}
EUVIMED