Federated Learning With Lossy Lempel–Ziv Gradient Compression
IEEE Transactions on Communications · 2026 · 74 · 15817-15831
DOI: 10.1109/tcomm.2026.3745158 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Communications, 2026. Verfasst von Yue Cao und 4 weiteren Autor:innen. Die Arbeit nennt 35 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Guangdong Basic and Applied Basic Research Foundation, ShanghaiTech AI Initiative.
Abstract (Originalsprache)
Federated Learning (FL) has gained widespread adoption for distributed model training due to its ability to preserve privacy and deliver promising learning performance. However, the limited availability of communication resources can significantly slow down the training process. To address this issue, this paper proposes two gradient compression schemes based on Lempel-Ziv (LZ) coding: Lossy Lempel-Ziv with element-wise distortion $p$ (LLZ- $p$ ) and Lossy Lempel-Ziv with Side Information (LLZ-SI). The LLZ- $p$ algorithm exploits the inherent redundancy within local gradients and introduces a controlled distortion into the vanilla Lempel-Ziv scheme. Our convergence analysis demonstrates that LLZ- $p$ can not only notably reduce communication costs, but also achieve a sublinear convergence rate comparable to that of its lossless counterpart. LLZ-SI further enhances compression by exploiting historical gradient information available at both clients and the server, effectively balancing the compression of current and past gradients. Extensive experiments on various datasets and learning models demonstrate that the proposed LZ-based schemes reduce communication by 58% without degrading accuracy and by up to 90% while maintaining nearly the same learning performance.
Förderung
- National Natural Science Foundation of China
- Guangdong Basic and Applied Basic Research Foundation
- ShanghaiTech AI Initiative
Zitieren
APA
Cao, Y., Liang, K., Wang, S., Zhong, H., & Wu, Y. (2026). Federated Learning With Lossy Lempel–Ziv Gradient Compression. IEEE Transactions on Communications, 74, 15817-15831. https://doi.org/10.1109/tcomm.2026.3745158
Vancouver
Cao Y, Liang K, Wang S, Zhong H, Wu Y. Federated Learning With Lossy Lempel–Ziv Gradient Compression. IEEE Transactions on Communications. 2026;74:15817-15831. doi:10.1109/tcomm.2026.3745158
BibTeX
@article{Cao2026,
author = {Cao, Yue and Liang, Kai and Wang, Shuoyao and Zhong, Huiru and Wu, Youlong},
title = {Federated Learning With Lossy Lempel–Ziv Gradient Compression},
journal = {IEEE Transactions on Communications},
year = {2026},
volume = {74},
pages = {15817--15831},
doi = {10.1109/tcomm.2026.3745158}
}
EUVIMED