Hierarchical Neuron Energy Feature Decoupled Distillation for Low-Resolution Face Recognition
Electronics · 29.07.2026 · 15 (15) · 3351
DOI: 10.3390/electronics15153351 ↗Kurz gefasst
Fachartikel in der Zeitschrift Electronics, online erschienen am 29.07.2026. Verfasst von Rui Zhong und 3 weiteren Autor:innen. Die Arbeit nennt 56 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Jiangxi Provincial Natural Science Foundation, Jiangxi Provincial Basic Education Research Project, Science and Technology Research Project of Jiangxi Provincial Department of Education.
Abstract (Originalsprache)
Low-resolution face recognition poses significant challenges in real-world applications, particularly for deployment on resource-constrained mobile terminals where both accuracy and efficiency are critical. While knowledge distillation has emerged as a promising solution, the existing methods suffer from performance degradation due to negative knowledge transfer when significant capacity gaps exist between teacher and student networks. To address the issue, we propose a novel Hierarchical Neuron Energy Feature Decoupled Distillation (HNEFDD) framework. Firstly, to mitigate the semantic feature gap between teacher and student networks, we integrate a neuron energy feature fusion transfer module into the student network. This module effectively aligns the features of teacher and student networks, alleviating negative knowledge transfer. At the same time, it can adaptively assign higher weights to discriminative facial regions, enabling the network to enhance locally robust structural information and extract semantically richer features in low-resolution face images. Secondly, to achieve efficient and accurate knowledge transfer, we employ a logit-standardized decoupled distillation mechanism that separates the distillation loss from the intermediate-layer auxiliary branches of the teacher and student networks into target-class and non-target-class components. This strategy enables the student network to more accurately learn both the key semantic representations of target-class features and the discriminative boundaries among non-target-class features, thereby achieving efficient and accurate knowledge transfer. Extensive experiments conducted on low-resolution benchmark datasets demonstrate the superiority of the proposed HNEFDD method, which outperforms the current state of the art (SOTA).
Förderung
- Jiangxi Provincial Natural Science Foundation
- Jiangxi Provincial Basic Education Research Project
- Science and Technology Research Project of Jiangxi Provincial Department of Education
- National Natural Science Foundation of China
Zitieren
APA
Zhong, R., Chen, B., Li, S., & Wang, T. (2026). Hierarchical Neuron Energy Feature Decoupled Distillation for Low-Resolution Face Recognition. Electronics, 15(15), 3351. https://doi.org/10.3390/electronics15153351
Vancouver
Zhong R, Chen B, Li S, Wang T. Hierarchical Neuron Energy Feature Decoupled Distillation for Low-Resolution Face Recognition. Electronics. 2026;15(15):3351. doi:10.3390/electronics15153351
BibTeX
@article{Zhong2026,
author = {Zhong, Rui and Chen, Bin and Li, Shenghao and Wang, Tinghua},
title = {Hierarchical Neuron Energy Feature Decoupled Distillation for Low-Resolution Face Recognition},
journal = {Electronics},
year = {2026},
volume = {15},
number = {15},
pages = {3351},
doi = {10.3390/electronics15153351}
}
EUVIMED