Hierarchical Federated Learning in Wireless Networks: Pruning Tackles Bandwidth Scarcity and System Heterogeneity
IEEE Transactions on Wireless Communications · 2024-09 · 23 (9) · 11417-11432
DOI: 10.1109/twc.2024.3382093 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Wireless Communications, 2024-09. Verfasst von Md Ferdous Pervej und 2 weiteren Autor:innen. Die Arbeit wurde bisher 30-mal zitiert (Crossref) und nennt 34 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Zhejiang Provincial Natural Science Foundation of China, Ng Teng Fong Charitable Foundation in the form of ZJU-SUTD IDEA.
Abstract (Originalsprache)
While a practical wireless network has many tiers where end users do not directly communicate with the central server, the users’ devices have limited computation and battery powers, and the serving base station (BS) has a fixed bandwidth. Owing to these practical constraints and system models, this paper leverages model pruning and proposes a pruning-enabled hierarchical federated learning (PHFL) in heterogeneous networks (HetNets). We first derive an upper bound of the convergence rate that clearly demonstrates the impact of the model pruning and wireless communications between the clients and the associated BS. Then we jointly optimize the model pruning ratio, central processing unit (CPU) frequency and transmission power of the clients in order to minimize the controllable terms of the convergence bound under strict delay and energy constraints. However, since the original problem is not convex, we perform successive convex approximation (SCA) and jointly optimize the parameters for the relaxed convex problem. Through extensive simulation, we validate the effectiveness of our proposed PHFL algorithm in terms of test accuracy, wall clock time, energy consumption and bandwidth requirement.
Förderung
- National Natural Science Foundation of China
- Zhejiang Provincial Natural Science Foundation of China
- Ng Teng Fong Charitable Foundation in the form of ZJU-SUTD IDEA
- U.S. National Science Foundation
Zitieren
APA
Pervej, M. F., Jin, R., & Dai, H. (2024). Hierarchical Federated Learning in Wireless Networks: Pruning Tackles Bandwidth Scarcity and System Heterogeneity. IEEE Transactions on Wireless Communications, 23(9), 11417-11432. https://doi.org/10.1109/twc.2024.3382093
Vancouver
Pervej MF, Jin R, Dai H. Hierarchical Federated Learning in Wireless Networks: Pruning Tackles Bandwidth Scarcity and System Heterogeneity. IEEE Transactions on Wireless Communications. 2024;23(9):11417-11432. doi:10.1109/twc.2024.3382093
BibTeX
@article{Pervej2024,
author = {Pervej, Md Ferdous and Jin, Richeng and Dai, Huaiyu},
title = {Hierarchical Federated Learning in Wireless Networks: Pruning Tackles Bandwidth Scarcity and System Heterogeneity},
journal = {IEEE Transactions on Wireless Communications},
year = {2024},
volume = {23},
number = {9},
pages = {11417--11432},
doi = {10.1109/twc.2024.3382093}
}
EUVIMED