When Action Speaks Louder than Words: Exploring Non-Verbal and Paraverbal Features in Dyadic Collaborative VR
Sensors · 2025
DOI: 10.3390/s25175498 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, 2025. Verfasst von Dennis Osei Tutu und 4 weiteren Autor:innen. Beteiligte Einrichtung: imec-mict-UGent, Department of Communication Sciences, Ghent University, Miriam Makebaplein 1, 9000 Ghent, Belgium. Hauptthemen laut MEDLINE: Virtual Reality, Speech. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 62 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Flemish Government.
Abstract (Originalsprache)
Soft skills such as communication and collaboration are vital in both professional and educational settings, yet difficult to train and assess objectively. Traditional role-playing scenarios rely heavily on subjective trainer evaluations—either in real time, where subtle behaviors are missed, or through time-intensive post hoc analysis. Virtual reality (VR) offers a scalable alternative by immersing trainees in controlled, interactive scenarios while simultaneously capturing fine-grained behavioral signals. This study investigates how task design in VR shapes non-verbal and paraverbal behaviors during dyadic collaboration. We compared two puzzle tasks: Task 1, which provided shared visual access and dynamic gesturing, and Task 2, which required verbal coordination through separation and turn-taking. From multimodal tracking data, we extracted features including gaze behaviors (eye contact, joint attention), hand gestures, facial expressions, and speech activity, and compared them across tasks. A clustering analysis explored whether o not tasks could be differentiated by their behavioral profiles. Results showed that Task 2, the more constrained condition, led participants to focus more visually on their own workspaces, suggesting that interaction difficulty can reduce partner-directed attention. Gestures were more frequent in shared-visual tasks, while speech became longer and more structured when turn-taking was enforced. Joint attention increased when participants relied on verbal descriptions rather than on a visible shared reference. These findings highlight how VR can elicit distinct soft skill behaviors through scenario design, enabling data-driven analysis of collaboration. This work contributes to scalable assessment frameworks with applications in training, adaptive agents, and human-AI collaboration.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- imec-mict-UGent, Department of Communication Sciences, Ghent University, Miriam Makebaplein 1, 9000 Ghent, Belgium.
- imec-itec-KULeuven, Department of Psychology and Educational Sciences, KU Leuven, Etienne Sabbelaan 51, 8500 Kortrijk, Belgium.
- imec-mict-UAntwerpen, Department of Product Development, University of Antwerp, Paardenmarkt 94, 2000 Antwerp, Belgium.
ORCID-Profile: Dennis Osei Tutu, Sepideh Habibiabad, Wim Van den Noortgate, Jelle Saldien, Klaas Bombeke
Förderung
- Flemish Government
Zitieren
APA
Osei Tutu, D., Habibiabad, S., Van den Noortgate, W., Saldien, J., & Bombeke, K. (2025). When Action Speaks Louder than Words: Exploring Non-Verbal and Paraverbal Features in Dyadic Collaborative VR. Sensors. https://doi.org/10.3390/s25175498
Vancouver
Osei Tutu D, Habibiabad S, Van den Noortgate W, Saldien J, Bombeke K. When Action Speaks Louder than Words: Exploring Non-Verbal and Paraverbal Features in Dyadic Collaborative VR. Sensors. 2025. doi:10.3390/s25175498
BibTeX
@article{OseiTutu2025,
author = {Osei Tutu, Dennis and Habibiabad, Sepideh and Van den Noortgate, Wim and Saldien, Jelle and Bombeke, Klaas},
title = {When Action Speaks Louder than Words: Exploring Non-Verbal and Paraverbal Features in Dyadic Collaborative VR},
journal = {Sensors},
year = {2025},
doi = {10.3390/s25175498}
}
EUVIMED