EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Efficient Cluster-Based Knowledge Distillation for Deep Face Recognition

Xianwei Lv, Haibo Mi, Xin Niu, Wang Chen, Kun Wang, Chen Yu

IEEE Transactions on Sustainable Computing · 2026-05 · 11 (3) · 253-265

DOI: 10.1109/tsusc.2026.3677896 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Sustainable Computing, 2026-05. Verfasst von Xianwei Lv und 5 weiteren Autor:innen. Die Arbeit nennt 50 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Science and Technology Major Project, National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Knowledge distillation has been widely used to improve the performance of small compact models for face recognition. However, selecting key knowledge and effectively transferring it from teacher to student remains a challenging problem. In this work, we propose an efficient Cluster-based Knowledge Distillation (CKD) dedicated to aligning the student model with the teacher model in terms of both sample relations and class centers. Specifically, CKD first determines the key sample relations based on the similarities between the sample features extracted by the teacher and their cluster centers generated by existing clustering algorithms. Then, CKD effectively transfers the knowledge of the above relations from the teacher to the student by designing a cluster-based relation distillation loss. Finally, CKD further improves the quality of the student's class centers by constructing a center loss between the above representative cluster centers and the student's class centers. We validate the proposed CKD on multiple face benchmarks. For example, CKD improves the baseline student performance from 91.95% to 94.20% on MegaFace and consistently outperforms recent competitive distillation methods on multiple benchmarks. These results demonstrate the effectiveness and superiority of CKD.

Förderung

  • National Science and Technology Major Project
  • National Natural Science Foundation of China

Zitieren

APA

Lv, X., Mi, H., Niu, X., Chen, W., Wang, K., & Yu, C. (2026). Efficient Cluster-Based Knowledge Distillation for Deep Face Recognition. IEEE Transactions on Sustainable Computing, 11(3), 253-265. https://doi.org/10.1109/tsusc.2026.3677896

Vancouver

Lv X, Mi H, Niu X, Chen W, Wang K, Yu C. Efficient Cluster-Based Knowledge Distillation for Deep Face Recognition. IEEE Transactions on Sustainable Computing. 2026;11(3):253-265. doi:10.1109/tsusc.2026.3677896

BibTeX
@article{Lv2026,
  author = {Lv, Xianwei and Mi, Haibo and Niu, Xin and Chen, Wang and Wang, Kun and Yu, Chen},
  title = {Efficient Cluster-Based Knowledge Distillation for Deep Face Recognition},
  journal = {IEEE Transactions on Sustainable Computing},
  year = {2026},
  volume = {11},
  number = {3},
  pages = {253--265},
  doi = {10.1109/tsusc.2026.3677896}
}
Kostenlos starten →