Efficient Cluster-Based Knowledge Distillation for Deep Face Recognition
IEEE Transactions on Sustainable Computing · 2026-05 · 11 (3) · 253-265
DOI: 10.1109/tsusc.2026.3677896 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Sustainable Computing, 2026-05. Verfasst von Xianwei Lv und 5 weiteren Autor:innen. Die Arbeit nennt 50 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Science and Technology Major Project, National Natural Science Foundation of China.
Abstract (Originalsprache)
Knowledge distillation has been widely used to improve the performance of small compact models for face recognition. However, selecting key knowledge and effectively transferring it from teacher to student remains a challenging problem. In this work, we propose an efficient Cluster-based Knowledge Distillation (CKD) dedicated to aligning the student model with the teacher model in terms of both sample relations and class centers. Specifically, CKD first determines the key sample relations based on the similarities between the sample features extracted by the teacher and their cluster centers generated by existing clustering algorithms. Then, CKD effectively transfers the knowledge of the above relations from the teacher to the student by designing a cluster-based relation distillation loss. Finally, CKD further improves the quality of the student's class centers by constructing a center loss between the above representative cluster centers and the student's class centers. We validate the proposed CKD on multiple face benchmarks. For example, CKD improves the baseline student performance from 91.95% to 94.20% on MegaFace and consistently outperforms recent competitive distillation methods on multiple benchmarks. These results demonstrate the effectiveness and superiority of CKD.
Förderung
- National Science and Technology Major Project
- National Natural Science Foundation of China
Zitieren
APA
Lv, X., Mi, H., Niu, X., Chen, W., Wang, K., & Yu, C. (2026). Efficient Cluster-Based Knowledge Distillation for Deep Face Recognition. IEEE Transactions on Sustainable Computing, 11(3), 253-265. https://doi.org/10.1109/tsusc.2026.3677896
Vancouver
Lv X, Mi H, Niu X, Chen W, Wang K, Yu C. Efficient Cluster-Based Knowledge Distillation for Deep Face Recognition. IEEE Transactions on Sustainable Computing. 2026;11(3):253-265. doi:10.1109/tsusc.2026.3677896
BibTeX
@article{Lv2026,
author = {Lv, Xianwei and Mi, Haibo and Niu, Xin and Chen, Wang and Wang, Kun and Yu, Chen},
title = {Efficient Cluster-Based Knowledge Distillation for Deep Face Recognition},
journal = {IEEE Transactions on Sustainable Computing},
year = {2026},
volume = {11},
number = {3},
pages = {253--265},
doi = {10.1109/tsusc.2026.3677896}
}
EUVIMED