Robust and Privacy-Preserving Decentralized Deep Federated Learning Training: Focusing on Digital Healthcare Applications
IEEE/ACM Transactions on Computational Biology and Bioinformatics · 2024-07 · 21 (4) · 890-901
DOI: 10.1109/tcbb.2023.3243932 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE/ACM Transactions on Computational Biology and Bioinformatics, 2024-07. Verfasst von Youliang Tian und 5 weiteren Autor:innen. Hauptthemen laut MEDLINE: Deep Learning, Computer Security. Die Arbeit wurde bisher 110-mal zitiert (Crossref) und nennt 48 Literaturangaben. Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China, Henan Key Laboratory of Network Cryptography Technology.
Abstract (Originalsprache)
Federated learning of deep neural networks has emerged as an evolving paradigm for distributed machine learning, gaining widespread attention due to its ability to update parameters without collecting raw data from users, especially in digital healthcare applications. However, the traditional centralized architecture of federated learning suffers from several problems (e.g., single point of failure, communication bottlenecks, etc.), especially malicious servers inferring gradients and causing gradient leakage. To tackle the above issues, we propose a robust and privacy-preserving decentralized deep federated learning (RPDFL) training scheme. Specifically, we design a novel ring FL structure and a Ring-Allreduce-based data sharing scheme to improve the communication efficiency in RPDFL training. Furthermore, we improve the process of distributing parameters of the Chinese residual theorem to update the execution process of the threshold secret sharing, supporting healthcare edge to drop out during the training process without causing data leakage, and ensuring the robustness of the RPDFL training under the Ring-Allreduce-based data sharing scheme. Security analysis indicates that RPDFL is provable secure. Experiment results show that RPDFL is significantly superior to standard FL methods in terms of model accuracy and convergence, and is suitable for digital healthcare applications.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Förderung
- National Key Research and Development Program of China
- National Natural Science Foundation of China
- Henan Key Laboratory of Network Cryptography Technology
- Project of High-level Innovative Talents of Guizhou Province
- Science and Technology Program of Guiyang
- Science and Technology Program of Guizhou Province
Zitieren
APA
Tian, Y., Wang, S., Xiong, J., Bi, R., Zhou, Z., & Bhuiyan, M. Z. A. (2024). Robust and Privacy-Preserving Decentralized Deep Federated Learning Training: Focusing on Digital Healthcare Applications. IEEE/ACM Transactions on Computational Biology and Bioinformatics, 21(4), 890-901. https://doi.org/10.1109/tcbb.2023.3243932
Vancouver
Tian Y, Wang S, Xiong J, Bi R, Zhou Z, Bhuiyan MZA. Robust and Privacy-Preserving Decentralized Deep Federated Learning Training: Focusing on Digital Healthcare Applications. IEEE/ACM Transactions on Computational Biology and Bioinformatics. 2024;21(4):890-901. doi:10.1109/tcbb.2023.3243932
BibTeX
@article{Tian2024,
author = {Tian, Youliang and Wang, Shuai and Xiong, Jinbo and Bi, Renwan and Zhou, Zhou and Bhuiyan, Md Zakirul Alam},
title = {Robust and Privacy-Preserving Decentralized Deep Federated Learning Training: Focusing on Digital Healthcare Applications},
journal = {IEEE/ACM Transactions on Computational Biology and Bioinformatics},
year = {2024},
volume = {21},
number = {4},
pages = {890--901},
doi = {10.1109/tcbb.2023.3243932}
}
EUVIMED