Federated Learning for Computationally Constrained Heterogeneous Devices: A Survey
ACM Computing Surveys · 31.12.2023 · 55 (14s) · 1-27
DOI: 10.1145/3596907 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Computing Surveys, online erschienen am 17.07.2023. Verfasst von Kilian Pfeiffer und 3 weiteren Autor:innen. Die Arbeit wurde bisher 122-mal zitiert (Crossref) und nennt 108 Literaturangaben. Gefördert von: Deutsches Bundesministerium für Bildung und Forschung (BMBF, Federal Ministry of Education and Research in Germany.
Abstract (Originalsprache)
With an increasing number of smart devices like internet of things devices deployed in the field, offloading training of neural networks (NNs) to a central server becomes more and more infeasible. Recent efforts to improve users’ privacy have led to on-device learning emerging as an alternative. However, a model trained only on a single device, using only local data, is unlikely to reach a high accuracy. Federated learning (FL) has been introduced as a solution, offering a privacy-preserving tradeoff between communication overhead and model accuracy by sharing knowledge between devices but disclosing the devices’ private data. The applicability and the benefit of applying baseline FL are, however, limited in many relevant use cases due to the heterogeneity present in such environments. In this survey, we outline the heterogeneity challenges FL has to overcome to be widely applicable in real-world applications. We especially focus on the aspect of computation heterogeneity among the participating devices and provide a comprehensive overview of recent works on heterogeneity-aware FL. We discuss two groups: works that adapt the NN architecture and works that approach heterogeneity on a system level, covering Federated Averaging, distillation, and split learning–based approaches, as well as synchronous and asynchronous aggregation schemes.
Förderung
- Deutsches Bundesministerium für Bildung und Forschung (BMBF, Federal Ministry of Education and Research in Germany
Zitieren
APA
Pfeiffer, K., Rapp, M., Khalili, R., & Henkel, J. (2023). Federated Learning for Computationally Constrained Heterogeneous Devices: A Survey. ACM Computing Surveys, 55(14s), 1-27. https://doi.org/10.1145/3596907
Vancouver
Pfeiffer K, Rapp M, Khalili R, Henkel J. Federated Learning for Computationally Constrained Heterogeneous Devices: A Survey. ACM Computing Surveys. 2023;55(14s):1-27. doi:10.1145/3596907
BibTeX
@article{Pfeiffer2023,
author = {Pfeiffer, Kilian and Rapp, Martin and Khalili, Ramin and Henkel, Jörg},
title = {Federated Learning for Computationally Constrained Heterogeneous Devices: A Survey},
journal = {ACM Computing Surveys},
year = {2023},
volume = {55},
number = {14s},
pages = {1--27},
doi = {10.1145/3596907}
}
EUVIMED