EUVIMEDEUVIMED entdecken
Open Access · CC BY-ND 4.0

Convolutional Neural Networks for Measuring Service Satisfaction of Hajj Pilgrims through Facial Expression Analysis

Undang Syaripudin, Jumadi Jumadi, Diena Rauda Ramdania, Indah Sri Lestari, Indri Nurfiani, Alfin Yogi Setyawan, Maisevli Harika, Mimin Mintarsih

Jurnal Online Informatika · 30.04.2026 · 11 (1) · 142-155

DOI: 10.15575/join.v11i1.1677 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Jurnal Online Informatika, online erschienen am 30.04.2026. Verfasst von Undang Syaripudin und 7 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Facial expressions serve as important non-verbal indicators of human emotions and can be leveraged to assess satisfaction levels in service environments. In the context of Hajj and Umrah, where verbal feedback may be limited due to language barriers or cultural factors, facial expression recognition offers a non-intrusive method to evaluate service quality. This study proposes a Convolutional Neural Network (CNN)-based model to detect emotional states such as happiness and dissatisfaction through facial expressions of pilgrims. A quantitative approach was adopted, employing preprocessing techniques including normalization, augmentation, and image resizing. The CNN architecture comprised multiple convolutional, pooling, and fully connected layers. The model was evaluated using accuracy, precision, recall, and F1-score metrics. Experiments with varying batch sizes (32, 64, 128, 256) across 50 epochs revealed that the optimal performance was achieved with a batch size of 64, resulting in an accuracy of 63%, precision of 66%, recall of 60%, and F1-score of 62%. During deployment, the model correctly classified 12 out of 16 real-world images, achieving a real-time accuracy of 78%. Therefore, the deployment results should be considered preliminary. Future studies will involve larger deployment samples, n-fold stratified cross-validation to obtain statistically reliable model performance, and subgroup analyses (e.g., lighting, facial pose, age, and gender) to better understand model behavior under diverse real-world conditions. All deployment images were collected with participant consent and processed without storing biometric data. These findings suggest that CNN-based emotion recognition can support real-time service evaluation and enhance the quality of pilgrim services during the Hajj and Umrah.

Zitieren

APA

Syaripudin, U., Jumadi, J., Ramdania, D. R., Lestari, I. S., Nurfiani, I., Setyawan, A. Y., Harika, M., & Mintarsih, M. (2026). Convolutional Neural Networks for Measuring Service Satisfaction of Hajj Pilgrims through Facial Expression Analysis. Jurnal Online Informatika, 11(1), 142-155. https://doi.org/10.15575/join.v11i1.1677

Vancouver

Syaripudin U, Jumadi J, Ramdania DR, Lestari IS, Nurfiani I, Setyawan AY, et al. Convolutional Neural Networks for Measuring Service Satisfaction of Hajj Pilgrims through Facial Expression Analysis. Jurnal Online Informatika. 2026;11(1):142-155. doi:10.15575/join.v11i1.1677

BibTeX
@article{Syaripudin2026,
  author = {Syaripudin, Undang and Jumadi, Jumadi and Ramdania, Diena Rauda and Lestari, Indah Sri and Nurfiani, Indri and Setyawan, Alfin Yogi and Harika, Maisevli and Mintarsih, Mimin},
  title = {Convolutional Neural Networks for Measuring Service Satisfaction of Hajj Pilgrims through Facial Expression Analysis},
  journal = {Jurnal Online Informatika},
  year = {2026},
  volume = {11},
  number = {1},
  pages = {142--155},
  doi = {10.15575/join.v11i1.1677}
}
Kostenlos starten →