EUVIMEDEUVIMED entdecken
Crossref

FedKD-MR: Enabling Heterogeneous Federated Learning through Multi-Round Knowledge Distillation

Claudio Silva, Cássio Prazeres

ACM Transactions on Internet of Things · 07.11.2026

DOI: 10.1145/3859281 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Internet of Things, online erschienen am 07.11.2026. Verfasst von Claudio Silva und 1 weiteren Autor:innen. Die Arbeit nennt 22 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In heterogeneous IoT deployments, federated learning is challenged not only by distributed, non-IID data but also by the possibility that participating devices may rely on incompatible model architectures. Under these conditions, classical parameter aggregation becomes difficult to apply because client weights cannot be meaningfully combined. FedKD-MR addresses this problem by shifting coordination from the parameter space to the output space: clients exchange logits computed on a shared, public reference dataset, enabling collaboration across heterogeneous models under a common input-label interface. Its main contribution is to organize this output-space exchange into a multi-round process in which consensus logits are repeatedly aggregated, redistributed, and reused during local distillation and supervised fine-tuning. We evaluate FedKD-MR on CIFAR-10 and CIFAR-100 under heterogeneous, non-IID client configurations, including cases in which parameter aggregation cannot be applied to the full client population. The results show gains over isolated local training. We further evaluate the method on UCI-HAR to examine a sensor-oriented setting and the role of the public anchor dataset. This analysis shows that public-set size, class coverage, and distributional quality directly affect the usefulness of consensus logits. Overall, the results support the use of multi-round logit reuse as a practical alternative for coordinating heterogeneous IoT clients when shared model weights are not feasible.

Zitieren

APA

Silva, C., & Prazeres, C. (2026). FedKD-MR: Enabling Heterogeneous Federated Learning through Multi-Round Knowledge Distillation. ACM Transactions on Internet of Things. https://doi.org/10.1145/3859281

Vancouver

Silva C, Prazeres C. FedKD-MR: Enabling Heterogeneous Federated Learning through Multi-Round Knowledge Distillation. ACM Transactions on Internet of Things. 2026. doi:10.1145/3859281

BibTeX
@article{Silva2026,
  author = {Silva, Claudio and Prazeres, Cássio},
  title = {FedKD-MR: Enabling Heterogeneous Federated Learning through Multi-Round Knowledge Distillation},
  journal = {ACM Transactions on Internet of Things},
  year = {2026},
  doi = {10.1145/3859281}
}
Kostenlos starten →