EUVIMEDEUVIMED entdecken
Crossref

Federated Distillation: A Survey

Lin Li, Jianping Gou, Baosheng Yu, Lan Du, Yi Zhang, Dacheng Tao

ACM Computing Surveys · 14.10.2026

DOI: 10.1145/3857792 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Computing Surveys, online erschienen am 14.10.2026. Verfasst von Lin Li und 5 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 226 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Federated learning (FL) enables collaborative model training without centralizing clients’ raw data, but parameter exchange can impose substantial communication costs and usually requires compatible model architectures. Federated distillation (FD) instead transfers predictive or intermediate knowledge through knowledge distillation (KD), which can support heterogeneous models and reduce communication in suitable settings. These benefits are not automatic: their magnitude depends on the transmitted knowledge, reference data, communication schedule, and threat model. This survey provides a challenge-centered synthesis of FD. We first formalize a representative public-data, response-based FD protocol and then organize existing methods by the FL challenges they address, including data, system, and model heterogeneity, client drift, catastrophic forgetting, communication cost, and privacy risk. We further review applications in industrial engineering, computer vision, natural language processing, and healthcare, including recent federated adaptation of large language models. Finally, we identify five research priorities: richer transferred knowledge, joint treatment of interacting forms of heterogeneity, communication-aware distillation, threat-model-driven privacy protection, and standardized theory, benchmarks, and evaluation.

Zitieren

APA

Li, L., Gou, J., Yu, B., Du, L., Zhang, Y., & Tao, D. (2026). Federated Distillation: A Survey. ACM Computing Surveys. https://doi.org/10.1145/3857792

Vancouver

Li L, Gou J, Yu B, Du L, Zhang Y, Tao D. Federated Distillation: A Survey. ACM Computing Surveys. 2026. doi:10.1145/3857792

BibTeX
@article{Li2026,
  author = {Li, Lin and Gou, Jianping and Yu, Baosheng and Du, Lan and Zhang, Yi and Tao, Dacheng},
  title = {Federated Distillation: A Survey},
  journal = {ACM Computing Surveys},
  year = {2026},
  doi = {10.1145/3857792}
}
Kostenlos starten →