Adaptive Period Control for Communication Efficient and Fast Convergent Federated Learning
IEEE Transactions on Mobile Computing · 2024-12 · 23 (12) · 12572-12586
DOI: 10.1109/tmc.2024.3416312 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Mobile Computing, 2024-12. Verfasst von Jude Tchaye-Kondi und 4 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 67 Literaturangaben. Gefördert von: Shandong Provincial Key Research and Development Program, Natural Key R&D of China.
Abstract (Originalsprache)
Federated Learning is particularly challenging in IoT environments, where edge and cloud nodes have imbalanced computation capacity and networking bandwidth. The main scalability barrier in distributed stochastic gradient descent-based machine learning frameworks is the communication overhead from frequent model parameter exchanges between workers and the central server. One way to reduce this overhead is by employing constant and periodic averaging, which sends model parameters to the server after a few iterations of local updates from workers. However, investigations have shown that the optimal communication period for balancing communication and convergence is not constant. Although some studies have explored the effectiveness of federated learning with a constant period, dynamically adjusting the period for optimal convergence remains under-explored. To address this, we investigate the impact of the period on global model convergence and propose an adaptive period control mechanism (AdaPC). This mechanism adaptively adjusts the aggregation period of the federated learning framework to achieve fast convergence with minimal communication. Our theoretical and empirical findings demonstrate that our proposed solution achieves faster convergence, lower final training loss, and minimized communication overhead compared to the constant period averaging strategy and other existing solutions.
Förderung
- Shandong Provincial Key Research and Development Program
- Natural Key R&D of China
Zitieren
APA
Tchaye-Kondi, J., Zhai, Y., Shen, J., Telikani, A., & Zhu, L. (2024). Adaptive Period Control for Communication Efficient and Fast Convergent Federated Learning. IEEE Transactions on Mobile Computing, 23(12), 12572-12586. https://doi.org/10.1109/tmc.2024.3416312
Vancouver
Tchaye-Kondi J, Zhai Y, Shen J, Telikani A, Zhu L. Adaptive Period Control for Communication Efficient and Fast Convergent Federated Learning. IEEE Transactions on Mobile Computing. 2024;23(12):12572-12586. doi:10.1109/tmc.2024.3416312
BibTeX
@article{TchayeKondi2024,
author = {Tchaye-Kondi, Jude and Zhai, Yanlong and Shen, Jun and Telikani, Akbar and Zhu, Liehuang},
title = {Adaptive Period Control for Communication Efficient and Fast Convergent Federated Learning},
journal = {IEEE Transactions on Mobile Computing},
year = {2024},
volume = {23},
number = {12},
pages = {12572--12586},
doi = {10.1109/tmc.2024.3416312}
}
EUVIMED