Model Recovery in Federated Unlearning With Restricted Server Data Resources
IEEE Internet of Things Journal · 01.06.2025 · 12 (11) · 17920-17935
DOI: 10.1109/jiot.2025.3540463 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Internet of Things Journal, erschienen am 01.06.2025. Verfasst von Jianxin Zhang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 45 Literaturangaben. Gefördert von: National Natural Science Foundation of China, China Postdoctoral Science Foundation, Liaoning Province Science and Technology Plan Joint Program.
Abstract (Originalsprache)
Recent model recovery methods in federated unlearning (FUL) either rely on additional communication with the remaining clients or require large amounts of high-quality data from the server for training, overlooking scenarios with limited data resources. Currently, contrastive language-image pretraining (CLIP) has demonstrated remarkable performance across a wide range of tasks, particularly excelling in few-shot learning scenarios. In this article, inspired by CLIP, we explore the scenario of few-shot knowledge distillation and propose CLIP-guided few-shot knowledge distillation (CGKD) for model recovery in FUL. CGKD mainly consists of three components: 1) the unlearning module constructs the unlearning model by erasing all historical contributions of the target client, and this model is treated as the student model; 2) fine-tuning the pretrained CLIP model using few-shot data from the server side to obtain a more robust teacher model (CLIP $^{\mathbf {*}}$ ); and 3) model recovery is achieved through knowledge distillation, leveraging the rich visual and semantic knowledge of CLIP $^{\mathbf {*}}$ to enhance the student model’s understanding of image semantic context, thereby improving the performance of the unlearning model. Extensive experimental results demonstrate that CGKD outperforms the compared FUL method in recovery performance across four standard datasets, validating the effectiveness of our approach.
Förderung
- National Natural Science Foundation of China
- China Postdoctoral Science Foundation
- Liaoning Province Science and Technology Plan Joint Program
- Science and Technology Project of Liaoning Province
- Dalian Science and Technology Talent Innovation Support Plan for Outstanding Young Scholars
- Xiaomi Young Talents Program
Zitieren
APA
Zhang, J., Zhao, M., Wang, Z., Su, W., & Wang, P. (2025). Model Recovery in Federated Unlearning With Restricted Server Data Resources. IEEE Internet of Things Journal, 12(11), 17920-17935. https://doi.org/10.1109/jiot.2025.3540463
Vancouver
Zhang J, Zhao M, Wang Z, Su W, Wang P. Model Recovery in Federated Unlearning With Restricted Server Data Resources. IEEE Internet of Things Journal. 2025;12(11):17920-17935. doi:10.1109/jiot.2025.3540463
BibTeX
@article{Zhang2025,
author = {Zhang, Jianxin and Zhao, Mengda and Wang, Zhenwei and Su, Weijian and Wang, Pengfei},
title = {Model Recovery in Federated Unlearning With Restricted Server Data Resources},
journal = {IEEE Internet of Things Journal},
year = {2025},
volume = {12},
number = {11},
pages = {17920--17935},
doi = {10.1109/jiot.2025.3540463}
}
EUVIMED