EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

pFedZKD: A One-Shot Personalized Federated Learning Framework via Evolutionary Architecture Search and Data-Free Distillation

Jiaqi Yan, Xuan Yang, Desheng Wang, Yonggang Xu, Gang Hua

Applied Sciences · 16.04.2026 · 16 (8) · 3878

DOI: 10.3390/app16083878 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 16.04.2026. Verfasst von Jiaqi Yan und 4 weiteren Autor:innen. Die Arbeit nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: gang hua, yonggang xu, xuanyang.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Personalized federated learning (PFL) faces significant challenges in resource-constrained edge environments, where strict communication budgets and severe system heterogeneity must be jointly addressed. Although one-shot federated learning reduces communication overhead, existing methods typically impose unified model architectures or rely on coarse manual selection strategies, limiting their adaptability to highly heterogeneous data distributions and restricting personalized representation capability. To overcome these limitations, we propose Personalized Federated Zero-shot Knowledge Distillation (pFedZKD), a data-free one-shot federated learning framework designed for structurally heterogeneous scenarios. The framework follows a decouple-and-reconstruct collaborative paradigm. On the client side (decoupling stage), we introduce Particle Swarm Optimization-based Federated Neural Architecture Search (PSO-FedNAS), a gradient-free neural architecture search method that enables each client to autonomously discover a customized convolutional architecture aligned with its local data distribution, eliminating the need for architectural consistency across clients. On the server side (reconstruction stage), to address parameter-space incompatibility caused by structural heterogeneity, we develop an architecture-agnostic multi-teacher zero-shot knowledge distillation mechanism (Multi-ZSKD). This method synthesizes pseudo-samples in latent space to extract semantic consensus from heterogeneous client models and transfers the aggregated knowledge to a unified global student model without accessing real data. The entire collaborative process is completed within a single communication round, substantially reducing communication cost while enhancing privacy preservation. Extensive experiments on MNIST, FashionMNIST, SVHN, and CIFAR-10 under heterogeneous data settings demonstrate that pFedZKD consistently achieves superior personalization accuracy, global generalization performance, and communication efficiency compared with state-of-the-art PFL methods.

Förderung

  • gang hua
  • yonggang xu
  • xuanyang

Zitieren

APA

Yan, J., Yang, X., Wang, D., Xu, Y., & Hua, G. (2026). pFedZKD: A One-Shot Personalized Federated Learning Framework via Evolutionary Architecture Search and Data-Free Distillation. Applied Sciences, 16(8), 3878. https://doi.org/10.3390/app16083878

Vancouver

Yan J, Yang X, Wang D, Xu Y, Hua G. pFedZKD: A One-Shot Personalized Federated Learning Framework via Evolutionary Architecture Search and Data-Free Distillation. Applied Sciences. 2026;16(8):3878. doi:10.3390/app16083878

BibTeX
@article{Yan2026,
  author = {Yan, Jiaqi and Yang, Xuan and Wang, Desheng and Xu, Yonggang and Hua, Gang},
  title = {pFedZKD: A One-Shot Personalized Federated Learning Framework via Evolutionary Architecture Search and Data-Free Distillation},
  journal = {Applied Sciences},
  year = {2026},
  volume = {16},
  number = {8},
  pages = {3878},
  doi = {10.3390/app16083878}
}
Kostenlos starten →