EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Privacy-Preserving Hierarchical Reinforcement Learning Framework for Task Offloading in Low-Altitude Vehicular Fog Computing

Zhiwei Wei, Jingxin Mao, Bing Li, Rongqing Zhang

IEEE Open Journal of the Communications Society · 2025 · 6 · 3389-3403

DOI: 10.1109/ojcoms.2024.3457023 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Open Journal of the Communications Society, 2025. Verfasst von Zhiwei Wei und 3 weiteren Autor:innen. Die Arbeit wurde bisher 36-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China, Natural Science Foundation of Shanghai.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Vehicular Fog Computing (VFC) is a promising paradigm in intelligent transportation systems (ITS), which offloads computation-intensive tasks to mobile fog nodes for real-time and low-latency services. In the forthcoming era of low-altitude economy, Unmanned Aerial Vehicles (UAVs) are being integrated as task-carrying entities into the ITS, and the novel low-altitude VFC is witnessing new challenges, introduced by dynamic UAV missions, high mobility, and privacy concerns. To preserve the offloading privacy and enhance the offloading performance in the dynamic low-altitude VFC, in this paper, we facilitate the learning-based methods and propose a hierarchical federated reinforcement learning framework. The framework consists of two levels: the local level provides Deep Reinforcement Learning (DRL) models for task vehicles and UAVs, and the cross-regional contextual level for coordinating the local experiences. At the local DRL level, we design an Attention-enhanced Federated Proximal Policy Optimization (AFedPPO) algorithm to enable decentralized training and execution (DTDE) for task offloading, which is privacy-preserving, effective, and scalable for the low-altitude VFC systems. At the cross-regional level, we introduce a contextual clustering and personalized (CCP) federated learning (FL) mechanism, which adaptively aggregates the local experiences according to the regional features. Extensive simulation results validate an average 35% improvement of the proposed framework compared to the state-of-the-art FL schemes, and in some cases, even outperform the centralized training (CTDE) baseline. To the best of our knowledge, this is the first work to theoretically discuss how contextual information can enhance the performance of the DRL-based offloading strategy under FL settings.

Förderung

  • National Key Research and Development Program of China
  • National Natural Science Foundation of China
  • Natural Science Foundation of Shanghai
  • Chenguang Program of Shanghai Education Development Foundation and Shanghai Municipal Education Commission
  • Fundamental Research Funds for the Central Universities

Zitieren

APA

Wei, Z., Mao, J., Li, B., & Zhang, R. (2025). Privacy-Preserving Hierarchical Reinforcement Learning Framework for Task Offloading in Low-Altitude Vehicular Fog Computing. IEEE Open Journal of the Communications Society, 6, 3389-3403. https://doi.org/10.1109/ojcoms.2024.3457023

Vancouver

Wei Z, Mao J, Li B, Zhang R. Privacy-Preserving Hierarchical Reinforcement Learning Framework for Task Offloading in Low-Altitude Vehicular Fog Computing. IEEE Open Journal of the Communications Society. 2025;6:3389-3403. doi:10.1109/ojcoms.2024.3457023

BibTeX
@article{Wei2025,
  author = {Wei, Zhiwei and Mao, Jingxin and Li, Bing and Zhang, Rongqing},
  title = {Privacy-Preserving Hierarchical Reinforcement Learning Framework for Task Offloading in Low-Altitude Vehicular Fog Computing},
  journal = {IEEE Open Journal of the Communications Society},
  year = {2025},
  volume = {6},
  pages = {3389--3403},
  doi = {10.1109/ojcoms.2024.3457023}
}
Kostenlos starten →