EUVIMEDEUVIMED entdecken
Crossref

Quantization Bits Allocation for Wireless Federated Learning

Muhang Lan, Qing Ling, Song Xiao, Wenyi Zhang

IEEE Transactions on Wireless Communications · 2023-11 · 22 (11) · 8336-8351

DOI: 10.1109/twc.2023.3262350 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Wireless Communications, 2023-11. Verfasst von Muhang Lan und 3 weiteren Autor:innen. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 49 Literaturangaben. Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Federated learning (FL) enables multiple clients to collaborate on a common learning task via only exchanging model updates. With the progressive improvements in deep learning models, communication is becoming a primary bottleneck of FL. Quantization of model updates before transmitting is an effective technique to reduce communication overhead. Most prior literature assumes lossless transmission, but in practice, quantized model updates are distorted by wireless channels due to the variation of client locations. Therefore, this paper focuses on analysis and design of personalized model update quantization with explicitly incorporating channel diversity in wireless FL. We present a novel convergence analysis of quantized FL, which encompasses full and partial client participation, single and multiple local training iterations, and convex and non-convex loss functions. This analysis explicitly embodies the impact of personalized quantization error, channel diversity and model aggregation in FL, and also elucidates their tradeoff on tightening a convergence rate upper bound. An optimization framework, which seeks an optimal allocation scheme given a total budget of quantization bits, is proposed by minimizing an upper bound with respect to channel quality. A nearly optimal solution is derived for this non-convex integer programming problem via analytically solving Karush–Kuhn–Tucker (KKT) optimality conditions and linear search. From a perspective of outlier detection, this channel-aware allocation scheme is also extended to robust model aggregation against client dropouts. Comprehensive numerical evaluation demonstrates the performance enhancement of the proposed scheme over the vanilla allocation scheme with equal quantization bits, particularly in terms of training stability, test accuracy, and robustness.

Förderung

  • National Key Research and Development Program of China
  • National Natural Science Foundation of China

Zitieren

APA

Lan, M., Ling, Q., Xiao, S., & Zhang, W. (2023). Quantization Bits Allocation for Wireless Federated Learning. IEEE Transactions on Wireless Communications, 22(11), 8336-8351. https://doi.org/10.1109/twc.2023.3262350

Vancouver

Lan M, Ling Q, Xiao S, Zhang W. Quantization Bits Allocation for Wireless Federated Learning. IEEE Transactions on Wireless Communications. 2023;22(11):8336-8351. doi:10.1109/twc.2023.3262350

BibTeX
@article{Lan2023,
  author = {Lan, Muhang and Ling, Qing and Xiao, Song and Zhang, Wenyi},
  title = {Quantization Bits Allocation for Wireless Federated Learning},
  journal = {IEEE Transactions on Wireless Communications},
  year = {2023},
  volume = {22},
  number = {11},
  pages = {8336--8351},
  doi = {10.1109/twc.2023.3262350}
}
Kostenlos starten →