Top-k Shuffled Differential Privacy Federated Learning for Heterogeneous Data
Sensors · 26.02.2025 · 25 (5) · 1441
DOI: 10.3390/s25051441 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 26.02.2025. Verfasst von Di Xiao und 2 weiteren Autor:innen. Beteiligte Einrichtung: College of Computer Science, Chongqing University, Chongqing 400044, China. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 25 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Chongqing Research Program of Basic Research and Frontier Technology (Chongqing Talent), Graduate Student Research and Innovation Foundation of Chongqing, China.
Abstract (Originalsprache)
Federated learning (FL) has emerged as a promising framework for training shared models across diverse participants, ensuring data remains securely stored on local devices. Despite its potential, FL still faces some critical challenges, including data heterogeneity, privacy risks, and substantial communication overhead. Current privacy-preserving FL research frequently fails to tackle complexities posed by heterogeneous data adequately, hence increasing communication expenses. To tackle these issues, we propose a top-k shuffled differential privacy FL (TopkSDP-FL) framework tailored to heterogeneous data environments. To address the model drift issue effectively, we design a novel regularization for local training, drawing inspiration from contrastive learning. To enhance efficiency, we propose a bidirectional top-k communication mechanism that reduces uplink and downlink overhead while strengthening privacy protection through double amplification with the shuffle model. Additionally, we shuffle all local gradient parameters at the layer level to address privacy budget concerns associated with high-dimensional aggregation and repeated iterations. Finally, a formal privacy analysis confirms the privacy amplification effect of TopkSDP-FL. The experimental results further demonstrate its superiority over other state-of-the-art FL methods, with an average accuracy improvement of 3% compared to FedAvg and other leading algorithms under the non-IID scenario, while also reducing communication costs by over 90%.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- College of Computer Science, Chongqing University, Chongqing 400044, China.
ORCID-Profile: Di Xiao
Förderung
- Chongqing Research Program of Basic Research and Frontier Technology (Chongqing Talent)
- Graduate Student Research and Innovation Foundation of Chongqing, China
Zitieren
APA
Xiao, D., Fan, X., & Chen, L. (2025). Top-k Shuffled Differential Privacy Federated Learning for Heterogeneous Data. Sensors, 25(5), 1441. https://doi.org/10.3390/s25051441
Vancouver
Xiao D, Fan X, Chen L. Top-k Shuffled Differential Privacy Federated Learning for Heterogeneous Data. Sensors. 2025;25(5):1441. doi:10.3390/s25051441
BibTeX
@article{Xiao2025,
author = {Xiao, Di and Fan, Xinchun and Chen, Lvjun},
title = {Top-k Shuffled Differential Privacy Federated Learning for Heterogeneous Data},
journal = {Sensors},
year = {2025},
volume = {25},
number = {5},
pages = {1441},
doi = {10.3390/s25051441}
}
EUVIMED