EUVIMEDEUVIMED entdecken
Crossref

Efficient Wireless Federated Learning With Partial Model Aggregation

Zhixiong Chen, Wenqiang Yi, Hyundong Shin, Arumugam Nallanathan, Geoffrey Ye Li

IEEE Transactions on Communications · 2024-10 · 72 (10) · 6271-6286

DOI: 10.1109/tcomm.2024.3396748 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Communications, 2024-10. Verfasst von Zhixiong Chen und 4 weiteren Autor:innen. Die Arbeit wurde bisher 23-mal zitiert (Crossref) und nennt 39 Literaturangaben. Gefördert von: Engineering and Physical Sciences Research Council (EPSRC), U.K..

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The data heterogeneity across clients and the limited communication resources, e.g., bandwidth and energy, are two of the main bottlenecks for wireless federated learning (FL). To tackle these challenges, we first devise a novel FL framework with partial model aggregation (PMA). This approach aggregates the lower layers of neural networks, responsible for feature extraction, at the parameter server while keeping the upper layers, responsible for complex pattern recognition, at clients for personalization. The proposed PMA-FL is able to address the data heterogeneity and reduce the transmitted information in wireless channels. Then, we derive a convergence bound of the framework under a non-convex loss function setting to reveal the role of unbalanced data size in the learning performance. On this basis, we maximize the scheduled data size to minimize the global loss function through jointly optimize the client selection, bandwidth allocation, computation and communication time division policies with the assistance of Lyapunov optimization. Our analysis reveals that the optimal time division is achieved when the communication and computation parts of PMA-FL have the same power. We also develop a bisection method to solve the optimal bandwidth allocation policy and use the set expansion algorithm to address the client scheduling policy. Compared with the benchmark schemes, the proposed PMA-FL improves 3.13% and 11.8% absolute accuracy on two typical datasets with heterogeneous data distribution settings, i.e., MINIST and CIFAR-10, respectively. In addition, the proposed joint dynamic client selection and resource management approach achieve slightly higher accuracy than the considered benchmarks, but they provide a satisfactory energy and time reduction: 29% energy or 20% time reduction on the MNIST; and 25% energy or 12.5% time reduction on the CIFAR-10.

Förderung

  • Engineering and Physical Sciences Research Council (EPSRC), U.K.

Zitieren

APA

Chen, Z., Yi, W., Shin, H., Nallanathan, A., & Li, G. Y. (2024). Efficient Wireless Federated Learning With Partial Model Aggregation. IEEE Transactions on Communications, 72(10), 6271-6286. https://doi.org/10.1109/tcomm.2024.3396748

Vancouver

Chen Z, Yi W, Shin H, Nallanathan A, Li GY. Efficient Wireless Federated Learning With Partial Model Aggregation. IEEE Transactions on Communications. 2024;72(10):6271-6286. doi:10.1109/tcomm.2024.3396748

BibTeX
@article{Chen2024,
  author = {Chen, Zhixiong and Yi, Wenqiang and Shin, Hyundong and Nallanathan, Arumugam and Li, Geoffrey Ye},
  title = {Efficient Wireless Federated Learning With Partial Model Aggregation},
  journal = {IEEE Transactions on Communications},
  year = {2024},
  volume = {72},
  number = {10},
  pages = {6271--6286},
  doi = {10.1109/tcomm.2024.3396748}
}
Kostenlos starten →