Convolutional Neural Networks for Measuring Service Satisfaction of Hajj Pilgrims through Facial Expression Analysis
Jurnal Online Informatika · 30.04.2026 · 11 (1) · 142-155
DOI: 10.15575/join.v11i1.1677 ↗Kurz gefasst
Fachartikel in der Zeitschrift Jurnal Online Informatika, online erschienen am 30.04.2026. Verfasst von Undang Syaripudin und 7 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-ND 4.0).
Abstract (Originalsprache)
Facial expressions serve as important non-verbal indicators of human emotions and can be leveraged to assess satisfaction levels in service environments. In the context of Hajj and Umrah, where verbal feedback may be limited due to language barriers or cultural factors, facial expression recognition offers a non-intrusive method to evaluate service quality. This study proposes a Convolutional Neural Network (CNN)-based model to detect emotional states such as happiness and dissatisfaction through facial expressions of pilgrims. A quantitative approach was adopted, employing preprocessing techniques including normalization, augmentation, and image resizing. The CNN architecture comprised multiple convolutional, pooling, and fully connected layers. The model was evaluated using accuracy, precision, recall, and F1-score metrics. Experiments with varying batch sizes (32, 64, 128, 256) across 50 epochs revealed that the optimal performance was achieved with a batch size of 64, resulting in an accuracy of 63%, precision of 66%, recall of 60%, and F1-score of 62%. During deployment, the model correctly classified 12 out of 16 real-world images, achieving a real-time accuracy of 78%. Therefore, the deployment results should be considered preliminary. Future studies will involve larger deployment samples, n-fold stratified cross-validation to obtain statistically reliable model performance, and subgroup analyses (e.g., lighting, facial pose, age, and gender) to better understand model behavior under diverse real-world conditions. All deployment images were collected with participant consent and processed without storing biometric data. These findings suggest that CNN-based emotion recognition can support real-time service evaluation and enhance the quality of pilgrim services during the Hajj and Umrah.
Zitieren
APA
Syaripudin, U., Jumadi, J., Ramdania, D. R., Lestari, I. S., Nurfiani, I., Setyawan, A. Y., Harika, M., & Mintarsih, M. (2026). Convolutional Neural Networks for Measuring Service Satisfaction of Hajj Pilgrims through Facial Expression Analysis. Jurnal Online Informatika, 11(1), 142-155. https://doi.org/10.15575/join.v11i1.1677
Vancouver
Syaripudin U, Jumadi J, Ramdania DR, Lestari IS, Nurfiani I, Setyawan AY, et al. Convolutional Neural Networks for Measuring Service Satisfaction of Hajj Pilgrims through Facial Expression Analysis. Jurnal Online Informatika. 2026;11(1):142-155. doi:10.15575/join.v11i1.1677
BibTeX
@article{Syaripudin2026,
author = {Syaripudin, Undang and Jumadi, Jumadi and Ramdania, Diena Rauda and Lestari, Indah Sri and Nurfiani, Indri and Setyawan, Alfin Yogi and Harika, Maisevli and Mintarsih, Mimin},
title = {Convolutional Neural Networks for Measuring Service Satisfaction of Hajj Pilgrims through Facial Expression Analysis},
journal = {Jurnal Online Informatika},
year = {2026},
volume = {11},
number = {1},
pages = {142--155},
doi = {10.15575/join.v11i1.1677}
}
EUVIMED