Multi-loss, feature fusion and improved top-two-voting ensemble for facial expression recognition in the wild
Neural Networks · 2025
DOI: 10.1016/j.neunet.2024.106937 ↗Kurz gefasst
Fachartikel in der Zeitschrift Neural Networks, 2025. Verfasst von Guangyao Zhou und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Computing and Artificial Intelligence, Southwest Jiaotong University, China. Electronic address: guangyao_zhou@my.swtju.edu.cn. Hauptthemen laut MEDLINE: Facial Expression, Neural Networks, Computer, Pattern Recognition, Automated, Automated Facial Recognition. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 47 Literaturangaben. Gefördert von: Key Research and Development Program of Sichuan Province, Chengdu Municipal Science and Technology Program.
Abstract (Originalsprache)
Facial expression recognition (FER) in the wild is a challenging pattern recognition task affected by the images' low quality and has attracted broad interest in computer vision. Existing FER methods failed to obtain sufficient accuracy to support the practical applications, especially in scenarios with low fault tolerance, which limits the adaptability of FER. Targeting exploring the possibility of further improving the accuracy of FER in the wild, this paper proposes a novel single model named R18+FAML and an ensemble model named R18+FAML-FGA-T2V, which applies intra-feature fusion within a single network, feature fusion among multiple networks, and the ensemble decision strategy. Based on the backbone of ResNet18 (R18), R18+FAML combines internal feature fusion and three attention blocks, as well as uses multiple loss functions (FAML) to improve the diversity of the feature extraction. To effectively integrate feature extractors from multiple networks, we propose feature fusion among networks based on the genetic algorithm (FGA). Comprehensively considering and utilizing more classification information, we propose an ensemble strategy, i.e., the improved top-two-voting (T2V) of multiple networks with the same structure. Combining the above strategies, R18+FAML-FGA-T2V can focus on the main expression-aware areas by integrating interest areas of multiple networks. From experiments on three challenging FER datasets in the wild including RAF-DB, AffectNet-8 and AffectNet-7, our single model R18+FAML and ensemble model R18+FAML-FGA-T2V achieve the accuracies of 90.32,62.17,65.83% and 91.59,63.27,66.63% respectively, both achieving the state-of-the-art results.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Computing and Artificial Intelligence, Southwest Jiaotong University, China. Electronic address: guangyao_zhou@my.swtju.edu.cn.
- School of Information and Software Engineering, University of Electronic Science and Technology of China, China.
- China National Offshore Oil Corporation, China.
Förderung
- Key Research and Development Program of Sichuan Province
- Chengdu Municipal Science and Technology Program
Zitieren
APA
Zhou, G., Xie, Y., Fu, Y., & Wang, Z. (2025). Multi-loss, feature fusion and improved top-two-voting ensemble for facial expression recognition in the wild. Neural Networks. https://doi.org/10.1016/j.neunet.2024.106937
Vancouver
Zhou G, Xie Y, Fu Y, Wang Z. Multi-loss, feature fusion and improved top-two-voting ensemble for facial expression recognition in the wild. Neural Networks. 2025. doi:10.1016/j.neunet.2024.106937
BibTeX
@article{Zhou2025,
author = {Zhou, Guangyao and Xie, Yuanlun and Fu, Yiqin and Wang, Zhaokun},
title = {Multi-loss, feature fusion and improved top-two-voting ensemble for facial expression recognition in the wild},
journal = {Neural Networks},
year = {2025},
doi = {10.1016/j.neunet.2024.106937}
}
EUVIMED