EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

FedDNA: Federated learning using dynamic node alignment

Shuwen Wang iD, Xingquan Zhu

PLOS ONE · 2023

DOI: 10.1371/journal.pone.0288157 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS ONE, 2023. Verfasst von Shuwen Wang und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electrical Engineering and Computer Science, Florida Atlantic University, Boca Raton, Florida, United States of America. Hauptthemen laut MEDLINE: Algorithms, Death. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 50 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Science Foundation.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Federated Learning (FL), as a new computing framework, has received significant attentions recently due to its advantageous in preserving data privacy in training models with superb performance. During FL learning, distributed sites first learn respective parameters. A central site will consolidate learned parameters, using average or other approaches, and disseminate new weights across all sites to carryout next round of learning. The distributed parameter learning and consolidation repeat in an iterative fashion until the algorithm converges or terminates. Many FL methods exist to aggregate weights from distributed sites, but most approaches use a static node alignment approach, where nodes of distributed networks are statically assigned, in advance, to match nodes and aggregate their weights. In reality, neural networks, especially dense networks, have nontransparent roles with respect to individual nodes. Combined with random nature of the networks, static node matching often does not result in best matching between nodes across sites. In this paper, we propose, FedDNA, a dynamic node alignment federated learning algorithm. Our theme is to find best matching nodes between different sites, and then aggregate weights of matching nodes for federated learning. For each node in a neural network, we represent its weight values as a vector, and use a distance function to find most similar nodes, i.e. , nodes with the smallest distance from other sides. Because finding best matching across all sites are computationally expensive, we further design a minimum spanning tree based approach to ensure that a node from each site will have matched peers from other sites, such that the total pairwise distances across all sites are minimized. Experiments and comparisons demonstrate that FedDNA outperforms commonly used baseline, such as FedAvg, for federated learning.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

AlgorithmsDeathHumansExhalationNeural Networks, ComputerPeer Group

Autor:innen und Institutionen

  • Department of Electrical Engineering and Computer Science, Florida Atlantic University, Boca Raton, Florida, United States of America.

ORCID-Profile: Shuwen Wang

Förderung

  • National Science Foundation

Zitieren

APA

Wang, S., & Zhu, X. (2023). FedDNA: Federated learning using dynamic node alignment. PLOS ONE. https://doi.org/10.1371/journal.pone.0288157

Vancouver

Wang S, Zhu X. FedDNA: Federated learning using dynamic node alignment. PLOS ONE. 2023. doi:10.1371/journal.pone.0288157

BibTeX
@article{Wang2023,
  author = {Wang, Shuwen and Zhu, Xingquan},
  title = {FedDNA: Federated learning using dynamic node alignment},
  journal = {PLOS ONE},
  year = {2023},
  doi = {10.1371/journal.pone.0288157}
}
Kostenlos starten →