EUVIMEDEUVIMED entdecken
Crossref

Multi-loss, feature fusion and improved top-two-voting ensemble for facial expression recognition in the wild

Guangyao Zhou, Yuanlun Xie, Yiqin Fu, Zhaokun Wang

Neural Networks · 2025

DOI: 10.1016/j.neunet.2024.106937 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Neural Networks, 2025. Verfasst von Guangyao Zhou und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Computing and Artificial Intelligence, Southwest Jiaotong University, China. Electronic address: guangyao_zhou@my.swtju.edu.cn. Hauptthemen laut MEDLINE: Facial Expression, Neural Networks, Computer, Pattern Recognition, Automated, Automated Facial Recognition. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 47 Literaturangaben. Gefördert von: Key Research and Development Program of Sichuan Province, Chengdu Municipal Science and Technology Program.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Facial expression recognition (FER) in the wild is a challenging pattern recognition task affected by the images' low quality and has attracted broad interest in computer vision. Existing FER methods failed to obtain sufficient accuracy to support the practical applications, especially in scenarios with low fault tolerance, which limits the adaptability of FER. Targeting exploring the possibility of further improving the accuracy of FER in the wild, this paper proposes a novel single model named R18+FAML and an ensemble model named R18+FAML-FGA-T2V, which applies intra-feature fusion within a single network, feature fusion among multiple networks, and the ensemble decision strategy. Based on the backbone of ResNet18 (R18), R18+FAML combines internal feature fusion and three attention blocks, as well as uses multiple loss functions (FAML) to improve the diversity of the feature extraction. To effectively integrate feature extractors from multiple networks, we propose feature fusion among networks based on the genetic algorithm (FGA). Comprehensively considering and utilizing more classification information, we propose an ensemble strategy, i.e., the improved top-two-voting (T2V) of multiple networks with the same structure. Combining the above strategies, R18+FAML-FGA-T2V can focus on the main expression-aware areas by integrating interest areas of multiple networks. From experiments on three challenging FER datasets in the wild including RAF-DB, AffectNet-8 and AffectNet-7, our single model R18+FAML and ensemble model R18+FAML-FGA-T2V achieve the accuracies of 90.32,62.17,65.83% and 91.59,63.27,66.63% respectively, both achieving the state-of-the-art results.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Facial ExpressionNeural Networks, ComputerPattern Recognition, AutomatedAutomated Facial RecognitionAlgorithmsHumansVoting

Stichwörter der Autor:innen

Deep learningEnsemble strategyFacial expression recognitionFeature fusionTop-two-voting

Autor:innen und Institutionen

  • School of Computing and Artificial Intelligence, Southwest Jiaotong University, China. Electronic address: guangyao_zhou@my.swtju.edu.cn.
  • School of Information and Software Engineering, University of Electronic Science and Technology of China, China.
  • China National Offshore Oil Corporation, China.

Förderung

  • Key Research and Development Program of Sichuan Province
  • Chengdu Municipal Science and Technology Program

Zitieren

APA

Zhou, G., Xie, Y., Fu, Y., & Wang, Z. (2025). Multi-loss, feature fusion and improved top-two-voting ensemble for facial expression recognition in the wild. Neural Networks. https://doi.org/10.1016/j.neunet.2024.106937

Vancouver

Zhou G, Xie Y, Fu Y, Wang Z. Multi-loss, feature fusion and improved top-two-voting ensemble for facial expression recognition in the wild. Neural Networks. 2025. doi:10.1016/j.neunet.2024.106937

BibTeX
@article{Zhou2025,
  author = {Zhou, Guangyao and Xie, Yuanlun and Fu, Yiqin and Wang, Zhaokun},
  title = {Multi-loss, feature fusion and improved top-two-voting ensemble for facial expression recognition in the wild},
  journal = {Neural Networks},
  year = {2025},
  doi = {10.1016/j.neunet.2024.106937}
}
Kostenlos starten →