EUVIMEDEUVIMED entdecken
Crossref

Layered Randomized Quantization for Communication-Efficient and Privacy-Preserving Distributed Learning

Guangfeng Yan, Tan Li, Kui Wu, Linqi Song

IEEE Journal on Selected Areas in Communications · 2025-07 · 43 (7) · 2684-2699

DOI: 10.1109/jsac.2025.3559136 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Journal on Selected Areas in Communications, 2025-07. Verfasst von Guangfeng Yan und 3 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 35 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Research Grants Council of Hong Kong, SAR, Collaborative Research Fund.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In distributed learning systems, ensuring efficient communication and privacy protection are two significant challenges. Although several existing works have attempted to address these challenges simultaneously, they often overlook essential learning-oriented features such as dynamic gradient and communication characteristics. In this paper, we propose a communication-efficient and privacy-preserving distributed SGD algorithm. Our proposed algorithm employs a layered randomized quantizer (LRQ) to reduce communication overhead, which also ensures that quantization errors follow an exact Gaussian distribution, thus achieving client-level differential privacy. We analyze the trade-off between convergence error, communication, and privacy under non-IID data distributions. Besides, we modify the algorithm to be training-adaptive by adjusting the per-round privacy budget allocation in response to i) dynamic gradient features and ii) real-time changing communication rounds. Both closed-form solutions are derived by solving the minimization problem of convergence error subject to the privacy budget constraint. Finally, we evaluate the effectiveness of our approach through extensive experiments on various datasets, including MNIST, CIFAR-10, and CIFAR-100, demonstrating its superiority in terms of communication cost, privacy protection, and model performance compared to state-of-the-art methods.

Förderung

  • National Natural Science Foundation of China
  • Research Grants Council of Hong Kong, SAR
  • Collaborative Research Fund
  • InnoHK Initiative, the Government of HKSAR, Laboratory for AI-Powered Financial Technologies

Zitieren

APA

Yan, G., Li, T., Wu, K., & Song, L. (2025). Layered Randomized Quantization for Communication-Efficient and Privacy-Preserving Distributed Learning. IEEE Journal on Selected Areas in Communications, 43(7), 2684-2699. https://doi.org/10.1109/jsac.2025.3559136

Vancouver

Yan G, Li T, Wu K, Song L. Layered Randomized Quantization for Communication-Efficient and Privacy-Preserving Distributed Learning. IEEE Journal on Selected Areas in Communications. 2025;43(7):2684-2699. doi:10.1109/jsac.2025.3559136

BibTeX
@article{Yan2025,
  author = {Yan, Guangfeng and Li, Tan and Wu, Kui and Song, Linqi},
  title = {Layered Randomized Quantization for Communication-Efficient and Privacy-Preserving Distributed Learning},
  journal = {IEEE Journal on Selected Areas in Communications},
  year = {2025},
  volume = {43},
  number = {7},
  pages = {2684--2699},
  doi = {10.1109/jsac.2025.3559136}
}
Kostenlos starten →