EUVIMEDEUVIMED entdecken
Crossref

Real-time Multi-CNN-based Emotion Recognition System for Evaluating Museum Visitors’ Satisfaction

Do Hyung Kwon, Jeong Min Yu

Journal on Computing and Cultural Heritage · 29.02.2024 · 17 (1) · 1-18

DOI: 10.1145/3631123 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal on Computing and Cultural Heritage, online erschienen am 23.02.2024. Verfasst von Do Hyung Kwon und 1 weiteren Autor:innen. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 60 Literaturangaben. Gefördert von: Academic Research in Korea National University of Cultural Heritage.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Conventional studies on the satisfaction of museum visitors focus on collecting information through surveys to provide a one-way service to visitors, and thus it is impossible to obtain feedback on the real-time satisfaction of visitors who are experiencing the museum exhibition program. In addition, museum practitioners lack research on automated ways to evaluate a produced content program's lifecycle and its appropriateness. To overcome these problems, we propose a novel multi-convolutional neural network, called VimoNet, which is able to recognize visitors emotions automatically in real-time based on their facial expressions and body gestures. Furthermore, we design a user preference model of content and a framework to obtain feedback on content improvement for providing personalized digital cultural heritage content to visitors. Specifically, we define seven emotions of visitors and build a dataset of visitor facial expressions and gestures with respect to the emotions. Using the dataset, we proceed with feature fusion of face and gesture images trained on the DenseNet-201 and VGG-16 models for generating a combined emotion recognition model. From the results of the experiment, VimoNet achieved a classification accuracy of 84.10%, providing 7.60% and 14.31% improvement, respectively, over a single face and body gesture-based method of emotion classification performance. It is thus possible to automatically capture the emotions of museum visitors via VimoNet, and we confirm its feasibility through a case study with respect to digital content of cultural heritage.

Förderung

  • Academic Research in Korea National University of Cultural Heritage

Zitieren

APA

Kwon, D. H., & Yu, J. M. (2024). Real-time Multi-CNN-based Emotion Recognition System for Evaluating Museum Visitors’ Satisfaction. Journal on Computing and Cultural Heritage, 17(1), 1-18. https://doi.org/10.1145/3631123

Vancouver

Kwon DH, Yu JM. Real-time Multi-CNN-based Emotion Recognition System for Evaluating Museum Visitors’ Satisfaction. Journal on Computing and Cultural Heritage. 2024;17(1):1-18. doi:10.1145/3631123

BibTeX
@article{Kwon2024,
  author = {Kwon, Do Hyung and Yu, Jeong Min},
  title = {Real-time Multi-CNN-based Emotion Recognition System for Evaluating Museum Visitors’ Satisfaction},
  journal = {Journal on Computing and Cultural Heritage},
  year = {2024},
  volume = {17},
  number = {1},
  pages = {1--18},
  doi = {10.1145/3631123}
}
Kostenlos starten →