Game Analysis and Incentive Mechanism Design for Differentially Private Cross-Silo Federated Learning
IEEE Transactions on Mobile Computing · 2024-10 · 23 (10) · 9337-9351
DOI: 10.1109/tmc.2024.3364372 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Mobile Computing, 2024-10. Verfasst von Wuxing Mao und 3 weiteren Autor:innen. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 53 Literaturangaben. Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China, Basic and Applied Basic Research Foundation of Guangdong Province.
Abstract (Originalsprache)
Cross-silo federated learning (FL) is a distributed learning method where clients collaboratively train a global model without exchanging local data. However, recent works reveal that potential privacy leakage occurs when clients upload their local updates. Although some works have studied privacy-preserving mechanisms in FL, the selfish privacy-preserving behaviors of clients are yet to be explored. In this paper, we formulate clients’ privacy-preserving behaviors in cross-silo FL as a multi-stage privacy preservation game, where each stage game corresponds to one training iteration. Specifically, clients selfishly perturb their local updates in each training iteration to trade off between convergence performance and privacy loss. To analyze the game, we first derive a novel theoretical bound to characterize the impact of clients’ local perturbations on the convergence of FL through analyzing the corrective effect of gradient descent in model training. With the novel convergence bound, we prove that the multi-stage privacy preservation game admits a unique subgame perfect Nash equilibrium (SPNE). We show that at the SPNE, the magnitude of each client's local perturbation decreases geometrically with training iterations. We then show that the efficiency decreases with the number of clients in some cases. To tackle this problem, we propose a socially efficient incentive mechanism that guarantees individual rationality, budget balance, and social efficiency. We further propose a truthful mechanism that achieves approximate social efficiency. Simulation results show that our proposed mechanisms can decrease clients’ total cost by up to 58.08% compared with that at the SPNE.
Förderung
- National Key Research and Development Program of China
- National Natural Science Foundation of China
- Basic and Applied Basic Research Foundation of Guangdong Province
Zitieren
APA
Mao, W., Ma, Q., Liao, G., & Chen, X. (2024). Game Analysis and Incentive Mechanism Design for Differentially Private Cross-Silo Federated Learning. IEEE Transactions on Mobile Computing, 23(10), 9337-9351. https://doi.org/10.1109/tmc.2024.3364372
Vancouver
Mao W, Ma Q, Liao G, Chen X. Game Analysis and Incentive Mechanism Design for Differentially Private Cross-Silo Federated Learning. IEEE Transactions on Mobile Computing. 2024;23(10):9337-9351. doi:10.1109/tmc.2024.3364372
BibTeX
@article{Mao2024,
author = {Mao, Wuxing and Ma, Qian and Liao, Guocheng and Chen, Xu},
title = {Game Analysis and Incentive Mechanism Design for Differentially Private Cross-Silo Federated Learning},
journal = {IEEE Transactions on Mobile Computing},
year = {2024},
volume = {23},
number = {10},
pages = {9337--9351},
doi = {10.1109/tmc.2024.3364372}
}
EUVIMED