pFedZKD: A One-Shot Personalized Federated Learning Framework via Evolutionary Architecture Search and Data-Free Distillation
Applied Sciences · 16.04.2026 · 16 (8) · 3878
DOI: 10.3390/app16083878 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 16.04.2026. Verfasst von Jiaqi Yan und 4 weiteren Autor:innen. Die Arbeit nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: gang hua, yonggang xu, xuanyang.
Abstract (Originalsprache)
Personalized federated learning (PFL) faces significant challenges in resource-constrained edge environments, where strict communication budgets and severe system heterogeneity must be jointly addressed. Although one-shot federated learning reduces communication overhead, existing methods typically impose unified model architectures or rely on coarse manual selection strategies, limiting their adaptability to highly heterogeneous data distributions and restricting personalized representation capability. To overcome these limitations, we propose Personalized Federated Zero-shot Knowledge Distillation (pFedZKD), a data-free one-shot federated learning framework designed for structurally heterogeneous scenarios. The framework follows a decouple-and-reconstruct collaborative paradigm. On the client side (decoupling stage), we introduce Particle Swarm Optimization-based Federated Neural Architecture Search (PSO-FedNAS), a gradient-free neural architecture search method that enables each client to autonomously discover a customized convolutional architecture aligned with its local data distribution, eliminating the need for architectural consistency across clients. On the server side (reconstruction stage), to address parameter-space incompatibility caused by structural heterogeneity, we develop an architecture-agnostic multi-teacher zero-shot knowledge distillation mechanism (Multi-ZSKD). This method synthesizes pseudo-samples in latent space to extract semantic consensus from heterogeneous client models and transfers the aggregated knowledge to a unified global student model without accessing real data. The entire collaborative process is completed within a single communication round, substantially reducing communication cost while enhancing privacy preservation. Extensive experiments on MNIST, FashionMNIST, SVHN, and CIFAR-10 under heterogeneous data settings demonstrate that pFedZKD consistently achieves superior personalization accuracy, global generalization performance, and communication efficiency compared with state-of-the-art PFL methods.
Förderung
- gang hua
- yonggang xu
- xuanyang
Zitieren
APA
Yan, J., Yang, X., Wang, D., Xu, Y., & Hua, G. (2026). pFedZKD: A One-Shot Personalized Federated Learning Framework via Evolutionary Architecture Search and Data-Free Distillation. Applied Sciences, 16(8), 3878. https://doi.org/10.3390/app16083878
Vancouver
Yan J, Yang X, Wang D, Xu Y, Hua G. pFedZKD: A One-Shot Personalized Federated Learning Framework via Evolutionary Architecture Search and Data-Free Distillation. Applied Sciences. 2026;16(8):3878. doi:10.3390/app16083878
BibTeX
@article{Yan2026,
author = {Yan, Jiaqi and Yang, Xuan and Wang, Desheng and Xu, Yonggang and Hua, Gang},
title = {pFedZKD: A One-Shot Personalized Federated Learning Framework via Evolutionary Architecture Search and Data-Free Distillation},
journal = {Applied Sciences},
year = {2026},
volume = {16},
number = {8},
pages = {3878},
doi = {10.3390/app16083878}
}
EUVIMED