Efficient Wireless Federated Learning With Partial Model Aggregation
IEEE Transactions on Communications · 2024-10 · 72 (10) · 6271-6286
DOI: 10.1109/tcomm.2024.3396748 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Communications, 2024-10. Verfasst von Zhixiong Chen und 4 weiteren Autor:innen. Die Arbeit wurde bisher 23-mal zitiert (Crossref) und nennt 39 Literaturangaben. Gefördert von: Engineering and Physical Sciences Research Council (EPSRC), U.K..
Abstract (Originalsprache)
The data heterogeneity across clients and the limited communication resources, e.g., bandwidth and energy, are two of the main bottlenecks for wireless federated learning (FL). To tackle these challenges, we first devise a novel FL framework with partial model aggregation (PMA). This approach aggregates the lower layers of neural networks, responsible for feature extraction, at the parameter server while keeping the upper layers, responsible for complex pattern recognition, at clients for personalization. The proposed PMA-FL is able to address the data heterogeneity and reduce the transmitted information in wireless channels. Then, we derive a convergence bound of the framework under a non-convex loss function setting to reveal the role of unbalanced data size in the learning performance. On this basis, we maximize the scheduled data size to minimize the global loss function through jointly optimize the client selection, bandwidth allocation, computation and communication time division policies with the assistance of Lyapunov optimization. Our analysis reveals that the optimal time division is achieved when the communication and computation parts of PMA-FL have the same power. We also develop a bisection method to solve the optimal bandwidth allocation policy and use the set expansion algorithm to address the client scheduling policy. Compared with the benchmark schemes, the proposed PMA-FL improves 3.13% and 11.8% absolute accuracy on two typical datasets with heterogeneous data distribution settings, i.e., MINIST and CIFAR-10, respectively. In addition, the proposed joint dynamic client selection and resource management approach achieve slightly higher accuracy than the considered benchmarks, but they provide a satisfactory energy and time reduction: 29% energy or 20% time reduction on the MNIST; and 25% energy or 12.5% time reduction on the CIFAR-10.
Förderung
- Engineering and Physical Sciences Research Council (EPSRC), U.K.
Zitieren
APA
Chen, Z., Yi, W., Shin, H., Nallanathan, A., & Li, G. Y. (2024). Efficient Wireless Federated Learning With Partial Model Aggregation. IEEE Transactions on Communications, 72(10), 6271-6286. https://doi.org/10.1109/tcomm.2024.3396748
Vancouver
Chen Z, Yi W, Shin H, Nallanathan A, Li GY. Efficient Wireless Federated Learning With Partial Model Aggregation. IEEE Transactions on Communications. 2024;72(10):6271-6286. doi:10.1109/tcomm.2024.3396748
BibTeX
@article{Chen2024,
author = {Chen, Zhixiong and Yi, Wenqiang and Shin, Hyundong and Nallanathan, Arumugam and Li, Geoffrey Ye},
title = {Efficient Wireless Federated Learning With Partial Model Aggregation},
journal = {IEEE Transactions on Communications},
year = {2024},
volume = {72},
number = {10},
pages = {6271--6286},
doi = {10.1109/tcomm.2024.3396748}
}
EUVIMED