EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Top-k Shuffled Differential Privacy Federated Learning for Heterogeneous Data

Di Xiao iD, Xinchun Fan, Lvjun Chen

Sensors · 26.02.2025 · 25 (5) · 1441

DOI: 10.3390/s25051441 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 26.02.2025. Verfasst von Di Xiao und 2 weiteren Autor:innen. Beteiligte Einrichtung: College of Computer Science, Chongqing University, Chongqing 400044, China. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 25 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Chongqing Research Program of Basic Research and Frontier Technology (Chongqing Talent), Graduate Student Research and Innovation Foundation of Chongqing, China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Federated learning (FL) has emerged as a promising framework for training shared models across diverse participants, ensuring data remains securely stored on local devices. Despite its potential, FL still faces some critical challenges, including data heterogeneity, privacy risks, and substantial communication overhead. Current privacy-preserving FL research frequently fails to tackle complexities posed by heterogeneous data adequately, hence increasing communication expenses. To tackle these issues, we propose a top-k shuffled differential privacy FL (TopkSDP-FL) framework tailored to heterogeneous data environments. To address the model drift issue effectively, we design a novel regularization for local training, drawing inspiration from contrastive learning. To enhance efficiency, we propose a bidirectional top-k communication mechanism that reduces uplink and downlink overhead while strengthening privacy protection through double amplification with the shuffle model. Additionally, we shuffle all local gradient parameters at the layer level to address privacy budget concerns associated with high-dimensional aggregation and repeated iterations. Finally, a formal privacy analysis confirms the privacy amplification effect of TopkSDP-FL. The experimental results further demonstrate its superiority over other state-of-the-art FL methods, with an average accuracy improvement of 3% compared to FedAvg and other leading algorithms under the non-IID scenario, while also reducing communication costs by over 90%.

Schlagwörter

Stichwörter der Autor:innen

communication costsdata heterogeneityfederated learningshuffle model

Autor:innen und Institutionen

  • College of Computer Science, Chongqing University, Chongqing 400044, China.

ORCID-Profile: Di Xiao

Förderung

  • Chongqing Research Program of Basic Research and Frontier Technology (Chongqing Talent)
  • Graduate Student Research and Innovation Foundation of Chongqing, China

Zitieren

APA

Xiao, D., Fan, X., & Chen, L. (2025). Top-k Shuffled Differential Privacy Federated Learning for Heterogeneous Data. Sensors, 25(5), 1441. https://doi.org/10.3390/s25051441

Vancouver

Xiao D, Fan X, Chen L. Top-k Shuffled Differential Privacy Federated Learning for Heterogeneous Data. Sensors. 2025;25(5):1441. doi:10.3390/s25051441

BibTeX
@article{Xiao2025,
  author = {Xiao, Di and Fan, Xinchun and Chen, Lvjun},
  title = {Top-k Shuffled Differential Privacy Federated Learning for Heterogeneous Data},
  journal = {Sensors},
  year = {2025},
  volume = {25},
  number = {5},
  pages = {1441},
  doi = {10.3390/s25051441}
}
Kostenlos starten →