Model-Oriented Training With Two-Stage Hierarchical Knowledge Distillation Under Non-IID Conditions in Federated Edge–Cloud Collaboration
IEEE Transactions on Cloud Computing · 2025-10 · 13 (4) · 1205-1221
DOI: 10.1109/tcc.2025.3620761 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Cloud Computing, 2025-10. Verfasst von Yishan Chen und 4 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 52 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Natural Science Foundation of Jiangxi Province, Key Laboratory of Multidimensional Intelligent Perception and Control of Jiangxi Province.
Abstract (Originalsprache)
With the continuous rolling-out of wireless edge cloud networks, Federated Learning (FL) has emerged as a promising solution for decentralized model training without exposing raw data. However, conventional centralized FL faces several limitations in resource-constrained mobile environments, including limited privacy-preserving capabilities and substantial communication overhead, which can lead to privacy leakage. Moreover, in non-independent and identically distributed (Non-IID) data environments, FL faces the critical challenge of “client drift”, which leads to performance degradation. To address these challenges, this paper proposes TWHFL, a two-stage hierarchical knowledge distillation framework for Non-IID federated learning, designed to enhance terminal privacy protection and improve model personalization under heterogeneous data distributions. Specifically, in the cloud-edge collaboration stage, edge servers generate pseudo “hard samples” for all sub-MEC centers by optimizing noise inputs guided by feature distribution statistics (e.g., batch normalization running means and variances). To alleviate label distribution skew, both the label proportions and the volume of pseudo data are dynamically adapted based on the real-time operational state of each sub-MEC center. In the edge-terminal collaboration stage, each sub-MEC center conducts localized training using both real and synthetic data without external communication, thereby significantly reducing the risk of privacy leakage. Furthermore, a joint optimization problem is formulated to determine optimal configurations of pruning rates, CPU frequencies, up-link power, and bandwidth allocation, while jointly considering constraints on convergence rate, energy consumption, and latency. Experimental results show that the proposed TWHFL framework can effectively balance privacy protection and model performance in Non-IID settings.
Förderung
- National Natural Science Foundation of China
- Natural Science Foundation of Jiangxi Province
- Key Laboratory of Multidimensional Intelligent Perception and Control of Jiangxi Province
Zitieren
APA
Chen, Y., Dai, W., Han, J., Qin, Z., & Deng, S. (2025). Model-Oriented Training With Two-Stage Hierarchical Knowledge Distillation Under Non-IID Conditions in Federated Edge–Cloud Collaboration. IEEE Transactions on Cloud Computing, 13(4), 1205-1221. https://doi.org/10.1109/tcc.2025.3620761
Vancouver
Chen Y, Dai W, Han J, Qin Z, Deng S. Model-Oriented Training With Two-Stage Hierarchical Knowledge Distillation Under Non-IID Conditions in Federated Edge–Cloud Collaboration. IEEE Transactions on Cloud Computing. 2025;13(4):1205-1221. doi:10.1109/tcc.2025.3620761
BibTeX
@article{Chen2025,
author = {Chen, Yishan and Dai, Wenshuo and Han, Junxiao and Qin, Zhen and Deng, Shuiguang},
title = {Model-Oriented Training With Two-Stage Hierarchical Knowledge Distillation Under Non-IID Conditions in Federated Edge–Cloud Collaboration},
journal = {IEEE Transactions on Cloud Computing},
year = {2025},
volume = {13},
number = {4},
pages = {1205--1221},
doi = {10.1109/tcc.2025.3620761}
}
EUVIMED