Context Attentive Dual Stream Emotion Aware Swin Transformer for Academic Emotion Recognition
International Journal of Computational Intelligence Systems · 04.11.2026
DOI: 10.1007/s44196-026-01679-0 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Computational Intelligence Systems, online erschienen am 04.11.2026. Verfasst von M. Shyamala Devi und 5 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Multimedia University.
Abstract (Originalsprache)
Enhancing academic engagement and adaptive learning systems requires an understanding of students’ emotions in the classroom. Conventional facial expression recognition techniques frequently fall short in educational environments because of issues such inadequate lighting, occlusion, changing head positions, and the requirement to record contextual data outside of the face. With three significant innovations, this study suggests a unique framework for robust academic emotion recognition called Context Attentive Cascaded Preprocessing with Dual Stream Emotion Aware Swin Transformer (CADE-Swin) to overcome these constraints. To preserve both fine-grained facial expressions and broader behavioral context, a Context Attentive Multi-Task Cascaded Convolutional Neural Network (CA-MTCNN) preprocessing is first constructed to jointly extract aligned face crops and face-context regions. Second, by combining emotion-aware attention heads, the Dual Stream Emotion Aware Swin Transformer (DE-Swin) architecture prioritizes salient facial and action unit regions while processing face-only and context crops simultaneously. Third, sequence-level reasoning for continuous engagement analysis is made possible by the extension of the DE-Swin model with cross-frame temporal attention. The DAiSEE KAGGLE dataset’s 6000 video segments were used to extract the original images that capture contextual and face signals. Six augmentation techniques are applied to 12,000 original classroom images of DAiSEE dataset to create an augmented dataset of 84,000 images, which guarantees data diversity and generalization. After that, the data is manually annotated into six academic emotion classes: frustrated, bored, engaged, confused, sleepy, and yawning. The proposed CADE-Swin system outperforms current state-of-the-art algorithms in academic emotion recognition with an impressive 96.13% classification accuracy when applied to annotated images. These findings show that combining dual-stream fusion, context-aware preprocessing, and temporal emotion attention yields a very successful technique to simulate complicated student actions in authentic classroom settings, opening the door for intelligent learning analytics.
Förderung
- Multimedia University
Zitieren
APA
Devi, M. S., Balasubaramanian, S., Hossen, M. J., Kit, W. W., Ng, P. K., & Prabagar, S. (2026). Context Attentive Dual Stream Emotion Aware Swin Transformer for Academic Emotion Recognition. International Journal of Computational Intelligence Systems. https://doi.org/10.1007/s44196-026-01679-0
Vancouver
Devi MS, Balasubaramanian S, Hossen MJ, Kit WW, Ng PK, Prabagar S. Context Attentive Dual Stream Emotion Aware Swin Transformer for Academic Emotion Recognition. International Journal of Computational Intelligence Systems. 2026. doi:10.1007/s44196-026-01679-0
BibTeX
@article{Devi2026,
author = {Devi, M. Shyamala and Balasubaramanian, Sundaravadivazhagan and Hossen, Md. Jakir and Kit, Wong Wai and Ng, Poh Kiat and Prabagar, S.},
title = {Context Attentive Dual Stream Emotion Aware Swin Transformer for Academic Emotion Recognition},
journal = {International Journal of Computational Intelligence Systems},
year = {2026},
doi = {10.1007/s44196-026-01679-0}
}
EUVIMED