Federated Learning via Variational Bayesian Inference: Personalization, Sparsity and Clustering
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2026-10 · 48 (10) · 12679-12693
DOI: 10.1109/tpami.2026.3699626 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2026-10. Verfasst von Xu Zhang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 50 Literaturangaben. Gefördert von: National Natural Science Foundation of China, China Postdoctoral Science Foundation.
Abstract (Originalsprache)
Federated learning (FL) is a promising framework that models distributed machine learning while protecting the privacy of clients. However, FL suffers performance degradation from heterogeneous and limited data. To alleviate the degradation, we present a novel personalized Bayesian FL approach named pFedBayes. By using the trained global distribution from the server as the prior distribution of each client, each client adjusts its own distribution by minimizing the sum of the reconstruction error over its personalized data and the KL divergence with the downloaded global distribution. Then, we propose a sparse personalized Bayesian FL approach named sFedBayes to enhance the inference efficiency. To overcome the extreme heterogeneity in non-i.i.d. data, we propose a clustered Bayesian FL model named cFedbayes by learning different prior distributions for different clients. Theoretical analysis gives the generalization error bound of three approaches and shows that the generalization error rates of the proposed approaches achieve minimax optimality up to a logarithmic factor. Moreover, cFedBayes achieves a cluster-level generalization error bound, rather than a single uniform bound in pFedBayes. Numerous experiments demonstrate that the proposed approaches have better performance than other advanced personalized methods on private models in the presence of heterogeneous and limited data.
Förderung
- National Natural Science Foundation of China
- China Postdoctoral Science Foundation
Zitieren
APA
Zhang, X., Li, W., Shao, Y., Liu, Y., Zhou, K., & Li, Y. (2026). Federated Learning via Variational Bayesian Inference: Personalization, Sparsity and Clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence, 48(10), 12679-12693. https://doi.org/10.1109/tpami.2026.3699626
Vancouver
Zhang X, Li W, Shao Y, Liu Y, Zhou K, Li Y. Federated Learning via Variational Bayesian Inference: Personalization, Sparsity and Clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2026;48(10):12679-12693. doi:10.1109/tpami.2026.3699626
BibTeX
@article{Zhang2026,
author = {Zhang, Xu and Li, Wenpeng and Shao, Yunfeng and Liu, Yonglin and Zhou, Kaiwen and Li, Yinchuan},
title = {Federated Learning via Variational Bayesian Inference: Personalization, Sparsity and Clustering},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2026},
volume = {48},
number = {10},
pages = {12679--12693},
doi = {10.1109/tpami.2026.3699626}
}
EUVIMED