EUVIMEDEUVIMED entdecken
Crossref

Federated Learning With Lossy Lempel–Ziv Gradient Compression

Yue Cao, Kai Liang, Shuoyao Wang, Huiru Zhong, Youlong Wu

IEEE Transactions on Communications · 2026 · 74 · 15817-15831

DOI: 10.1109/tcomm.2026.3745158 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Communications, 2026. Verfasst von Yue Cao und 4 weiteren Autor:innen. Die Arbeit nennt 35 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Guangdong Basic and Applied Basic Research Foundation, ShanghaiTech AI Initiative.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Federated Learning (FL) has gained widespread adoption for distributed model training due to its ability to preserve privacy and deliver promising learning performance. However, the limited availability of communication resources can significantly slow down the training process. To address this issue, this paper proposes two gradient compression schemes based on Lempel-Ziv (LZ) coding: Lossy Lempel-Ziv with element-wise distortion $p$ (LLZ- $p$ ) and Lossy Lempel-Ziv with Side Information (LLZ-SI). The LLZ- $p$ algorithm exploits the inherent redundancy within local gradients and introduces a controlled distortion into the vanilla Lempel-Ziv scheme. Our convergence analysis demonstrates that LLZ- $p$ can not only notably reduce communication costs, but also achieve a sublinear convergence rate comparable to that of its lossless counterpart. LLZ-SI further enhances compression by exploiting historical gradient information available at both clients and the server, effectively balancing the compression of current and past gradients. Extensive experiments on various datasets and learning models demonstrate that the proposed LZ-based schemes reduce communication by 58% without degrading accuracy and by up to 90% while maintaining nearly the same learning performance.

Förderung

  • National Natural Science Foundation of China
  • Guangdong Basic and Applied Basic Research Foundation
  • ShanghaiTech AI Initiative

Zitieren

APA

Cao, Y., Liang, K., Wang, S., Zhong, H., & Wu, Y. (2026). Federated Learning With Lossy Lempel–Ziv Gradient Compression. IEEE Transactions on Communications, 74, 15817-15831. https://doi.org/10.1109/tcomm.2026.3745158

Vancouver

Cao Y, Liang K, Wang S, Zhong H, Wu Y. Federated Learning With Lossy Lempel–Ziv Gradient Compression. IEEE Transactions on Communications. 2026;74:15817-15831. doi:10.1109/tcomm.2026.3745158

BibTeX
@article{Cao2026,
  author = {Cao, Yue and Liang, Kai and Wang, Shuoyao and Zhong, Huiru and Wu, Youlong},
  title = {Federated Learning With Lossy Lempel–Ziv Gradient Compression},
  journal = {IEEE Transactions on Communications},
  year = {2026},
  volume = {74},
  pages = {15817--15831},
  doi = {10.1109/tcomm.2026.3745158}
}
Kostenlos starten →