Auditory, Visual, or Both? Comparing Visual and Auditory Representations of Game Elements in a Gamified Image-Tagging Task
Proceedings of the ACM on Human-Computer Interaction · 2024-10-14 · 8 (CHI PLAY) · 1-28
DOI: 10.1145/3677059 ↗At a glance
Journal article in Proceedings of the ACM on Human-Computer Interaction, published online on 2024-10-15. Written by Marc Schubhan and 5 co-authors. Cited 6 times so far (Crossref); 86 references.
Abstract (original language)
In gamification users show increased motivation and engagement towards tasks. So far, this effect has mostly been empirically tested based on the visual depiction of game elements, while research on the use and addition of auditory aspects is sparse. In this work we investigate the effect of different modalities of game elements (auditory, visual, audiovisual) on user experience, perception and performance in a gamified image-tagging task. We approached this via an online validation survey to find suitable sound effects (N=50), a main quantitative study (N=109) and a qualitative semi-structured interview (N=9). Our results show that while visual gamification increases performance, auditory and audiovisual gamification had no effect. However, they were shown to have an influence on the user's flow state. Our qualitative follow-up study shed light on underlying reasons and revealed each modality has its own drawbacks and advantages and that combining both visual and auditory aspects was preferred by participants.
Cite
APA
Schubhan, M., Altmeyer, M., Rogers, K., Degraen, D., Lessel, P., & Krüger, A. (2024). Auditory, Visual, or Both? Comparing Visual and Auditory Representations of Game Elements in a Gamified Image-Tagging Task. Proceedings of the ACM on Human-Computer Interaction, 8(CHI PLAY), 1-28. https://doi.org/10.1145/3677059
Vancouver
Schubhan M, Altmeyer M, Rogers K, Degraen D, Lessel P, Krüger A. Auditory, Visual, or Both? Comparing Visual and Auditory Representations of Game Elements in a Gamified Image-Tagging Task. Proceedings of the ACM on Human-Computer Interaction. 2024;8(CHI PLAY):1-28. doi:10.1145/3677059
BibTeX
@article{Schubhan2024,
author = {Schubhan, Marc and Altmeyer, Maximilian and Rogers, Katja and Degraen, Donald and Lessel, Pascal and Krüger, Antonio},
title = {Auditory, Visual, or Both? Comparing Visual and Auditory Representations of Game Elements in a Gamified Image-Tagging Task},
journal = {Proceedings of the ACM on Human-Computer Interaction},
year = {2024},
volume = {8},
number = {CHI PLAY},
pages = {1--28},
doi = {10.1145/3677059}
}
EUVIMED