EUVIMEDEUVIMED entdecken
Crossref

Federated Learning via Variational Bayesian Inference: Personalization, Sparsity and Clustering

Xu Zhang, Wenpeng Li, Yunfeng Shao, Yonglin Liu, Kaiwen Zhou, Yinchuan Li

IEEE Transactions on Pattern Analysis and Machine Intelligence · 2026-10 · 48 (10) · 12679-12693

DOI: 10.1109/tpami.2026.3699626 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2026-10. Verfasst von Xu Zhang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 50 Literaturangaben. Gefördert von: National Natural Science Foundation of China, China Postdoctoral Science Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Federated learning (FL) is a promising framework that models distributed machine learning while protecting the privacy of clients. However, FL suffers performance degradation from heterogeneous and limited data. To alleviate the degradation, we present a novel personalized Bayesian FL approach named pFedBayes. By using the trained global distribution from the server as the prior distribution of each client, each client adjusts its own distribution by minimizing the sum of the reconstruction error over its personalized data and the KL divergence with the downloaded global distribution. Then, we propose a sparse personalized Bayesian FL approach named sFedBayes to enhance the inference efficiency. To overcome the extreme heterogeneity in non-i.i.d. data, we propose a clustered Bayesian FL model named cFedbayes by learning different prior distributions for different clients. Theoretical analysis gives the generalization error bound of three approaches and shows that the generalization error rates of the proposed approaches achieve minimax optimality up to a logarithmic factor. Moreover, cFedBayes achieves a cluster-level generalization error bound, rather than a single uniform bound in pFedBayes. Numerous experiments demonstrate that the proposed approaches have better performance than other advanced personalized methods on private models in the presence of heterogeneous and limited data.

Förderung

  • National Natural Science Foundation of China
  • China Postdoctoral Science Foundation

Zitieren

APA

Zhang, X., Li, W., Shao, Y., Liu, Y., Zhou, K., & Li, Y. (2026). Federated Learning via Variational Bayesian Inference: Personalization, Sparsity and Clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence, 48(10), 12679-12693. https://doi.org/10.1109/tpami.2026.3699626

Vancouver

Zhang X, Li W, Shao Y, Liu Y, Zhou K, Li Y. Federated Learning via Variational Bayesian Inference: Personalization, Sparsity and Clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2026;48(10):12679-12693. doi:10.1109/tpami.2026.3699626

BibTeX
@article{Zhang2026,
  author = {Zhang, Xu and Li, Wenpeng and Shao, Yunfeng and Liu, Yonglin and Zhou, Kaiwen and Li, Yinchuan},
  title = {Federated Learning via Variational Bayesian Inference: Personalization, Sparsity and Clustering},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year = {2026},
  volume = {48},
  number = {10},
  pages = {12679--12693},
  doi = {10.1109/tpami.2026.3699626}
}
Kostenlos starten →