Hierarchical Deep Reinforcement Learning-Based Partial Task Offloading in Device-Edge-Cloud Computing Architecture
IEEE Transactions on Consumer Electronics · 2026-02 · 72 (1) · 1051-1063
DOI: 10.1109/tce.2025.3611973 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Consumer Electronics, 2026-02. Verfasst von Ihsan Ullah und 3 weiteren Autor:innen. Die Arbeit nennt 44 Literaturangaben. Gefördert von: National Science and Technology Council of Taiwan, National Research Foundation of Korea, Ministry of Education.
Abstract (Originalsprache)
The rapid growth of the Intelligent Internet of Things (IIoT) and 5G applications demands high-performance computing, low latency, and energy efficiency, often beyond the capacity of local devices. Task offloading to edge or cloud servers offers a promising solution. However, achieving optimal partial task distribution across device, edge, and cloud remains challenging due to dynamic network conditions, heterogeneous resources, and conflicting performance objectives. This paper presents a Hierarchical Deep Reinforcement Learning (HDRL) framework for intelligent, resource-aware, latency-constrained partial task offloading in device–edge–cloud architectures. The problem is formulated as a two-level Markov Decision Process (MDP) for structured decision-making. At the high level, a Double Deep Q-Network (DDQN) agent observes the global network state and selects computation tiers. At the low level, a Proximal Policy Optimization (PPO) agent determines optimal task-splitting ratios, enabling fine-grained control of subtask distribution. The HDRL framework jointly optimizes energy consumption, task acceptance ratio, and resource utilization while ensuring end-to-end latency constraints. The system adapts dynamically to varying workloads and resource availability. Simulations showed that HDRL-PTO achieved 80–90% task acceptance, reduced energy consumption compared to DRL-PTO and DRL-TO, and consistently delivered higher episode rewards across Network I and II.
Förderung
- National Science and Technology Council of Taiwan
- National Research Foundation of Korea
- Ministry of Education
Zitieren
APA
Ullah, I., Lim, H., Seok, Y., & Han, Y. (2026). Hierarchical Deep Reinforcement Learning-Based Partial Task Offloading in Device-Edge-Cloud Computing Architecture. IEEE Transactions on Consumer Electronics, 72(1), 1051-1063. https://doi.org/10.1109/tce.2025.3611973
Vancouver
Ullah I, Lim H, Seok Y, Han Y. Hierarchical Deep Reinforcement Learning-Based Partial Task Offloading in Device-Edge-Cloud Computing Architecture. IEEE Transactions on Consumer Electronics. 2026;72(1):1051-1063. doi:10.1109/tce.2025.3611973
BibTeX
@article{Ullah2026,
author = {Ullah, Ihsan and Lim, Hyun-Kyo and Seok, Yeong-Jun and Han, Youn-Hee},
title = {Hierarchical Deep Reinforcement Learning-Based Partial Task Offloading in Device-Edge-Cloud Computing Architecture},
journal = {IEEE Transactions on Consumer Electronics},
year = {2026},
volume = {72},
number = {1},
pages = {1051--1063},
doi = {10.1109/tce.2025.3611973}
}
EUVIMED