EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Robust emotion recognition for complex environments: ChildEmoNet model based on DETR-ResNet50 cascaded architecture

Zhang Shanshan iD, Sha Yanlin, Loy Chee Luen

PLOS One · 2025

DOI: 10.1371/journal.pone.0332130 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS One, 2025. Verfasst von Zhang Shanshan und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Early Childhood Education, Faculty of National Child Development Research Centre, Universiti Pendidikan Sultan Idris, Perak, Malaysia. Hauptthemen laut MEDLINE: Emotions, Facial Recognition. Die Arbeit nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Emotion recognition faces significant challenges in complex real-world environments, particularly under facial occlusion conditions that severely impact traditional deep learning approaches. This research proposes ChildEmoNet, a novel cascaded emotion recognition framework that strategically integrates Detection Transformer (DETR) for robust multi-person detection with ResNet50 for discriminative feature extraction. The primary contributions include the development of a cascaded DETR-ResNet50 architecture that addresses both detection and classification challenges simultaneously, enhanced robustness mechanisms specifically designed for facial occlusion scenarios, and comprehensive evaluation across both categorical and dimensional emotion recognition tasks. Extensive experiments on the OMG Emotion Dataset demonstrate the effectiveness of this integration: the proposed model achieves an AUC of 0.93 in standard emotion classification tasks, maintains 79% recognition accuracy under 30% facial occlusion conditions, and attains concordance correlation coefficients (CCC) of 0.52 and 0.46 for valence and arousal prediction, respectively. The experimental validation confirms the crucial role of the DETR module in processing multi-person scenarios and the effectiveness of ResNet50 in feature extraction, demonstrating superior performance across complex environmental conditions including varying lighting, face orientations, and partial occlusions. Compared with traditional methods, this cascaded architecture shows remarkable robustness under challenging real-world conditions. This research advances emotion computing technology by providing a robust solution for emotion recognition applications in complex environments where conventional approaches exhibit significant performance degradation.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

EmotionsFacial RecognitionHumansFacial ExpressionDeep LearningAlgorithms

Autor:innen und Institutionen

  • Department of Early Childhood Education, Faculty of National Child Development Research Centre, Universiti Pendidikan Sultan Idris, Perak, Malaysia.
  • Music Department, Faculty of Creative Arts, Universiti Malaya, Kuala Lumpur, Malaysia.
  • Department of Early Childhood Education, Faculty of Human Development, Universiti Pendidikan Sultan Idris, Perak, Malaysia.

ORCID-Profile: Zhang Shanshan

Zitieren

APA

Shanshan, Z., Yanlin, S., & Luen, L. C. (2025). Robust emotion recognition for complex environments: ChildEmoNet model based on DETR-ResNet50 cascaded architecture. PLOS One. https://doi.org/10.1371/journal.pone.0332130

Vancouver

Shanshan Z, Yanlin S, Luen LC. Robust emotion recognition for complex environments: ChildEmoNet model based on DETR-ResNet50 cascaded architecture. PLOS One. 2025. doi:10.1371/journal.pone.0332130

BibTeX
@article{Shanshan2025,
  author = {Shanshan, Zhang and Yanlin, Sha and Luen, Loy Chee},
  title = {Robust emotion recognition for complex environments: ChildEmoNet model based on DETR-ResNet50 cascaded architecture},
  journal = {PLOS One},
  year = {2025},
  doi = {10.1371/journal.pone.0332130}
}
Kostenlos starten →