Cooperative Content Caching in Vehicular Edge Computing Networks: A Two-Stage Deep Reinforcement Learning Approach
IEEE Transactions on Mobile Computing · 2026-07 · 25 (7) · 10557-10576
DOI: 10.1109/tmc.2026.3664597 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Mobile Computing, 2026-07. Verfasst von Hongbo Jiang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 27-mal zitiert (Crossref) und nennt 49 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Selected Best Candidates to Undertake Key Research Projects of Changsha City, Yuelushan Center for Industrial Innovation.
Abstract (Originalsprache)
In vehicular edge computing (VEC) networks, by implementing content caching and V2X connectivity, road side unit (RSU) and nearby vehicles can serve as platforms for rapid data retrieval to address mobile traffic explosion. However, due to the dynamic and multi-constrained environment consisting of heterogeneous vehicles and RSU, it is challenging to meticulously plan cooperative caching policies. Additionally, due to the diversity of contents and the mobility of vehicles, the caching policy space is massive, which can be fatal for vehicles with limited computing and energy. In this paper, we formulate cooperative content caching in VEC networks as Markov decision process (MDP), configuring caching policies for vehicles and RSU. Our aim is to minimize Lyapunov drift and long-term delay. To address the massive caching policies, we propose a two-stage deep reinforcement learning (TS-DRL) algorithm. In the first stage, an improved ant colony algorithm is used to generate unilateral suggestions and construct action space to avoid the curse of dimensionality. In the second stage, we combine the Noisy Net and Double Deep Q-Learning Network to avoid overestimating value and efficient exploration problem. Simulation results show that TS-DRL outperforms advanced algorithms in terms of delay and cache hit rate.
Förderung
- National Natural Science Foundation of China
- Selected Best Candidates to Undertake Key Research Projects of Changsha City
- Yuelushan Center for Industrial Innovation
- Science and Technology Innovation Program of Hunan Province
- Hunan Natural Science Foundation of China
- Shenzhen Science and Technology Program
- Science and Technology Program of Hunan Provincial Departmant of Transportation
Zitieren
APA
Jiang, H., Guo, J., Xiao, Z., Yang, J., Yang, K., & Min, G. (2026). Cooperative Content Caching in Vehicular Edge Computing Networks: A Two-Stage Deep Reinforcement Learning Approach. IEEE Transactions on Mobile Computing, 25(7), 10557-10576. https://doi.org/10.1109/tmc.2026.3664597
Vancouver
Jiang H, Guo J, Xiao Z, Yang J, Yang K, Min G. Cooperative Content Caching in Vehicular Edge Computing Networks: A Two-Stage Deep Reinforcement Learning Approach. IEEE Transactions on Mobile Computing. 2026;25(7):10557-10576. doi:10.1109/tmc.2026.3664597
BibTeX
@article{Jiang2026,
author = {Jiang, Hongbo and Guo, Jianghao and Xiao, Zhu and Yang, Jiali and Yang, Kehua and Min, Geyong},
title = {Cooperative Content Caching in Vehicular Edge Computing Networks: A Two-Stage Deep Reinforcement Learning Approach},
journal = {IEEE Transactions on Mobile Computing},
year = {2026},
volume = {25},
number = {7},
pages = {10557--10576},
doi = {10.1109/tmc.2026.3664597}
}
EUVIMED