FedSQ: Sparse-Quantized Federated Learning for Communication Efficiency
IEEE Transactions on Consumer Electronics · 2024-02 · 70 (1) · 4050-4061
DOI: 10.1109/tce.2024.3352432 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Consumer Electronics, 2024-02. Verfasst von Zhong Long und 4 weiteren Autor:innen. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 50 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Guizhou Provincial Department of Science and Technology Hundred Level Innovative Talent Program through Qian Ke He Platform Talent, Top Technology Talent Project from Guizhou Education Department.
Abstract (Originalsprache)
In this paper, we explore an emerging customer application named federated learning in Mobile Edge Computing (MEC). Federated learning is a machine learning technique that enables data privacy and avoids data silos. However, federated learning tasks with high performance often face large model parameters and high communication costs. To address this challenge, this paper presents FedSQ (Federated Learning with Sparsity and Quantization), a novel sparsity and quantization strategy that reduces communication overhead and enhances model convergence. FedSQ selectively uploads the parameters with large gradient change ratios and uses the old values from the previous round for the parameters with small gradient change ratios. FedSQ also incorporates an error compensation mechanism with correction to mitigate the compression loss and balance the model parameters between the current and previous rounds. We conduct experiments on standard datasets and demonstrate that FedSQ achieves high compression ratio without sacrificing the model accuracy significantly in various federated learning tasks. Across all communication rounds, FedSQ achieved the highest accuracy improvement of 25.74% and the highest compression rate of 97.98%. Our research provides a novel intelligent data-driven model for consumer electronics, which can improve the communication efficiency and model convergence of client applications in MEC.
Förderung
- National Natural Science Foundation of China
- Guizhou Provincial Department of Science and Technology Hundred Level Innovative Talent Program through Qian Ke He Platform Talent
- Top Technology Talent Project from Guizhou Education Department
- Scientific and Technological Research Projects from Guizhou Education Department
Zitieren
APA
Long, Z., Chen, Y., Dou, H., Zhang, Y., & Chen, Y. (2024). FedSQ: Sparse-Quantized Federated Learning for Communication Efficiency. IEEE Transactions on Consumer Electronics, 70(1), 4050-4061. https://doi.org/10.1109/tce.2024.3352432
Vancouver
Long Z, Chen Y, Dou H, Zhang Y, Chen Y. FedSQ: Sparse-Quantized Federated Learning for Communication Efficiency. IEEE Transactions on Consumer Electronics. 2024;70(1):4050-4061. doi:10.1109/tce.2024.3352432
BibTeX
@article{Long2024,
author = {Long, Zhong and Chen, Yuling and Dou, Hui and Zhang, Yangwen and Chen, Yao},
title = {FedSQ: Sparse-Quantized Federated Learning for Communication Efficiency},
journal = {IEEE Transactions on Consumer Electronics},
year = {2024},
volume = {70},
number = {1},
pages = {4050--4061},
doi = {10.1109/tce.2024.3352432}
}
EUVIMED