Boosting Dynamic Decentralized Federated Learning by Diversifying Model Sources
IEEE Transactions on Services Computing · 2024-07 · 17 (4) · 1400-1413
DOI: 10.1109/tsc.2024.3377157 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Services Computing, 2024-07. Verfasst von Dongyuan Su und 3 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 40 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Basic and Applied Basic Research Foundation of Guangdong Province, Shenzhen Science and Technology Program.
Abstract (Originalsprache)
Recently, federated learning (FL) has received intensive research because of its ability in preserving data privacy for scattered clients to collaboratively train machine learning models. Decentralized federated learning (DFL) is upgraded from FL which allows clients to aggregate model parameters with their neighbours directly. DFL is particularly feasible for dynamic systems, in which the neighbour set of each client is dynamic. However, due to the restrictions of client trajectories and communication distances, it is hard for individual clients to sufficiently exchange models with others, resulting in poor model accuracy. To address this challenge, we propose the DFL-DMS (DFL with Diversified Model Sources) algorithm to diversify sources for model aggregation, and improve model utility. Specifically, models exchanged between DFL-DMS clients are jointly determined by their staleness scores and the bandwidth constraint. An asynchronous learning mode is adopted so that DFL-DMS clients can temporarily store and relay fresh models collected from different client sources to accelerate the propagation of rare models. A state vector is maintained to track the contribution weight of each source to its model aggregation, and an entropy based metric (EBM) is optimized by clients in a distributed manner. Finally, the superiority of DFL-DMS is evaluated by extensive experiments (with MNIST and CIFAR-10 datasets) which demonstrate that DFL-DMS can accelerate the convergence of DFL and improve the model accuracy significantly compared with the state-of-the-art baselines.
Förderung
- National Natural Science Foundation of China
- Basic and Applied Basic Research Foundation of Guangdong Province
- Shenzhen Science and Technology Program
- Research Team Cultivation Program of ShenZhen University
Zitieren
APA
Su, D., Zhou, Y., Cui, L., & Guo, S. (2024). Boosting Dynamic Decentralized Federated Learning by Diversifying Model Sources. IEEE Transactions on Services Computing, 17(4), 1400-1413. https://doi.org/10.1109/tsc.2024.3377157
Vancouver
Su D, Zhou Y, Cui L, Guo S. Boosting Dynamic Decentralized Federated Learning by Diversifying Model Sources. IEEE Transactions on Services Computing. 2024;17(4):1400-1413. doi:10.1109/tsc.2024.3377157
BibTeX
@article{Su2024,
author = {Su, Dongyuan and Zhou, Yipeng and Cui, Laizhong and Guo, Song},
title = {Boosting Dynamic Decentralized Federated Learning by Diversifying Model Sources},
journal = {IEEE Transactions on Services Computing},
year = {2024},
volume = {17},
number = {4},
pages = {1400--1413},
doi = {10.1109/tsc.2024.3377157}
}
EUVIMED