EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

ArecaNet: Robust Facial Emotion Recognition via Assembled Residual Enhanced Cross-Attention Networks for Emotion-Aware Human–Computer Interaction

Jaemyung Kim iD, Gyuho Choi iD

Sensors · 2025

DOI: 10.3390/s25237375 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, 2025. Verfasst von Jaemyung Kim und 1 weiteren Autor:innen. Beteiligte Einrichtung: IT Research Institute, Chosun University, Gwangju 61452, Republic of Korea. Hauptthemen laut MEDLINE: Emotions, Facial Recognition. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: This research was supported by the National Research Foundation of Korea(NRF) grant funded by the Korea government(MSIT), Chosun University, National Research Foundation of Korea.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recently, the convergence of advanced sensor technologies and innovations in artificial intelligence and robotics has highlighted facial emotion recognition (FER) as an essential component of human–computer interaction (HCI). Traditional FER studies based on handcrafted features and shallow machine learning have shown a limited performance, while convolutional neural networks (CNNs) have improved nonlinear emotion pattern analysis but have been constrained by local feature extraction. Vision transformers (ViTs) have addressed this by leveraging global correlations, yet both CNN- and ViT-based single networks often suffer from overfitting, single-network dependency, and information loss in ensemble operations. To overcome these limitations, we propose ArecaNet, an assembled residual enhanced cross-attention network that integrates multiple feature streams without information loss. The framework comprises (i) channel and spatial feature extraction via SCSESResNet, (ii) landmark feature extraction from specialized sub-networks, (iii) iterative fusion through residual enhanced cross-attention, (iv) final emotion classification from the fused representation. Our research introduces a novel approach by integrating pre-trained sub-networks specialized in facial recognition with an attention mechanism and our uniquely designed main network, which is optimized for size reduction and efficient feature extraction. The extracted features are fused through an iterative residual enhanced cross-attention mechanism, which minimizes information loss and preserves complementary representations across networks. This strategy overcomes the limitations of conventional ensemble methods, enabling seamless feature integration and robust recognition. The experimental results show that the proposed ArecaNet achieved accuracies of 97.0% and 97.8% using the public databases, FER-2013 and RAF-DB, which were 4.5% better than the existing state-of-the-art method, PAtt-Lite, for FER-2013 and 2.75% for RAF-DB, and achieved a new state-of-the-art accuracy for each database.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

EmotionsFacial RecognitionHumansNeural Networks, ComputerMachine LearningAlgorithmsFacial ExpressionArtificial Intelligence

Stichwörter der Autor:innen

attention fusioncomputer visionfacial emotion recognitionmulti-model ensembleresidual cross-attention

Autor:innen und Institutionen

  • IT Research Institute, Chosun University, Gwangju 61452, Republic of Korea.
  • Department of Artificial Intelligence Engineering, Chosun University, Gwangju 61452, Republic of Korea.

ORCID-Profile: Jaemyung Kim, Gyuho Choi

Förderung

  • This research was supported by the National Research Foundation of Korea(NRF) grant funded by the Korea government(MSIT)
  • Chosun University
  • National Research Foundation of Korea

Zitieren

APA

Kim, J., & Choi, G. (2025). ArecaNet: Robust Facial Emotion Recognition via Assembled Residual Enhanced Cross-Attention Networks for Emotion-Aware Human–Computer Interaction. Sensors. https://doi.org/10.3390/s25237375

Vancouver

Kim J, Choi G. ArecaNet: Robust Facial Emotion Recognition via Assembled Residual Enhanced Cross-Attention Networks for Emotion-Aware Human–Computer Interaction. Sensors. 2025. doi:10.3390/s25237375

BibTeX
@article{Kim2025,
  author = {Kim, Jaemyung and Choi, Gyuho},
  title = {ArecaNet: Robust Facial Emotion Recognition via Assembled Residual Enhanced Cross-Attention Networks for Emotion-Aware Human–Computer Interaction},
  journal = {Sensors},
  year = {2025},
  doi = {10.3390/s25237375}
}
Kostenlos starten →