EUVIMEDEUVIMED entdecken
Crossref

IFL-GAN: Improved Federated Learning Generative Adversarial Network With Maximum Mean Discrepancy Model Aggregation

Wei Li, Jinlin Chen, Zhenyu Wang, Zhidong Shen, Chao Ma, Xiaohui Cui

IEEE Transactions on Neural Networks and Learning Systems · 2023-12 · 34 (12) · 10502-10515

DOI: 10.1109/tnnls.2022.3167482 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Neural Networks and Learning Systems, 2023-12. Verfasst von Wei Li und 5 weiteren Autor:innen. Die Arbeit wurde bisher 77-mal zitiert (Crossref) und nennt 34 Literaturangaben. Gefördert von: Fundamental Research Funds for the Central Universities, 2021 Jiangsu Shuangchuang (Mass Innovation and Entrepreneurship) Talent Program, Open Foundation of Engineering Research Center of Cyberspace.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The generative adversarial network (GAN) is usually built from the centralized, independent identically distributed (i.i.d.) training data to generate realistic-like instances. In real-world applications, however, the data may be distributed over multiple clients and hard to be gathered due to bandwidth, departmental coordination, or storage concerns. Although existing works, such as federated learning GAN (FL-GAN), adopt different distributed strategies to train GAN models, there are still limitations when data are distributed in a non-i.i.d. manner. These studies suffer from convergence difficulty, producing generated data with low quality. Fortunately, we found that these challenges are often due to the use of a federated averaging strategy to aggregate local GAN models' updates. In this article, we propose an alternative approach to tackling this problem, which learns a globally shared GAN model by aggregating locally trained generators' updates with maximum mean discrepancy (MMD). In this way, we term our approach improved FL-GAN (IFL-GAN). The MMD score helps each local GAN hold different weights, making the global GAN in IFL-GAN getting converged more rapidly than federated averaging. Extensive experiments on MNIST, CIFAR10, and SVHN datasets demonstrate the significant improvement of our IFL-GAN in both achieving the highest inception score and producing high-quality instances.

Förderung

  • Fundamental Research Funds for the Central Universities
  • 2021 Jiangsu Shuangchuang (Mass Innovation and Entrepreneurship) Talent Program
  • Open Foundation of Engineering Research Center of Cyberspace

Zitieren

APA

Li, W., Chen, J., Wang, Z., Shen, Z., Ma, C., & Cui, X. (2023). IFL-GAN: Improved Federated Learning Generative Adversarial Network With Maximum Mean Discrepancy Model Aggregation. IEEE Transactions on Neural Networks and Learning Systems, 34(12), 10502-10515. https://doi.org/10.1109/tnnls.2022.3167482

Vancouver

Li W, Chen J, Wang Z, Shen Z, Ma C, Cui X. IFL-GAN: Improved Federated Learning Generative Adversarial Network With Maximum Mean Discrepancy Model Aggregation. IEEE Transactions on Neural Networks and Learning Systems. 2023;34(12):10502-10515. doi:10.1109/tnnls.2022.3167482

BibTeX
@article{Li2023,
  author = {Li, Wei and Chen, Jinlin and Wang, Zhenyu and Shen, Zhidong and Ma, Chao and Cui, Xiaohui},
  title = {IFL-GAN: Improved Federated Learning Generative Adversarial Network With Maximum Mean Discrepancy Model Aggregation},
  journal = {IEEE Transactions on Neural Networks and Learning Systems},
  year = {2023},
  volume = {34},
  number = {12},
  pages = {10502--10515},
  doi = {10.1109/tnnls.2022.3167482}
}
Kostenlos starten →