EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

When Action Speaks Louder than Words: Exploring Non-Verbal and Paraverbal Features in Dyadic Collaborative VR

Dennis Osei Tutu iD, Sepideh Habibiabad iD, Wim Van den Noortgate iD, Jelle Saldien iD, Klaas Bombeke iD

Sensors · 2025

DOI: 10.3390/s25175498 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, 2025. Verfasst von Dennis Osei Tutu und 4 weiteren Autor:innen. Beteiligte Einrichtung: imec-mict-UGent, Department of Communication Sciences, Ghent University, Miriam Makebaplein 1, 9000 Ghent, Belgium. Hauptthemen laut MEDLINE: Virtual Reality, Speech. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 62 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Flemish Government.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Soft skills such as communication and collaboration are vital in both professional and educational settings, yet difficult to train and assess objectively. Traditional role-playing scenarios rely heavily on subjective trainer evaluations—either in real time, where subtle behaviors are missed, or through time-intensive post hoc analysis. Virtual reality (VR) offers a scalable alternative by immersing trainees in controlled, interactive scenarios while simultaneously capturing fine-grained behavioral signals. This study investigates how task design in VR shapes non-verbal and paraverbal behaviors during dyadic collaboration. We compared two puzzle tasks: Task 1, which provided shared visual access and dynamic gesturing, and Task 2, which required verbal coordination through separation and turn-taking. From multimodal tracking data, we extracted features including gaze behaviors (eye contact, joint attention), hand gestures, facial expressions, and speech activity, and compared them across tasks. A clustering analysis explored whether o not tasks could be differentiated by their behavioral profiles. Results showed that Task 2, the more constrained condition, led participants to focus more visually on their own workspaces, suggesting that interaction difficulty can reduce partner-directed attention. Gestures were more frequent in shared-visual tasks, while speech became longer and more structured when turn-taking was enforced. Joint attention increased when participants relied on verbal descriptions rather than on a visible shared reference. These findings highlight how VR can elicit distinct soft skill behaviors through scenario design, enabling data-driven analysis of collaboration. This work contributes to scalable assessment frameworks with applications in training, adaptive agents, and human-AI collaboration.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Virtual RealitySpeechHumansMaleFemaleAdultGesturesCooperative BehaviorYoung AdultAttentionFacial ExpressionNonverbal Communication

Stichwörter der Autor:innen

VR interaction analysiscollaborationcommunicationmultimodal behavior trackingsoft skills training

Autor:innen und Institutionen

  • imec-mict-UGent, Department of Communication Sciences, Ghent University, Miriam Makebaplein 1, 9000 Ghent, Belgium.
  • imec-itec-KULeuven, Department of Psychology and Educational Sciences, KU Leuven, Etienne Sabbelaan 51, 8500 Kortrijk, Belgium.
  • imec-mict-UAntwerpen, Department of Product Development, University of Antwerp, Paardenmarkt 94, 2000 Antwerp, Belgium.

ORCID-Profile: Dennis Osei Tutu, Sepideh Habibiabad, Wim Van den Noortgate, Jelle Saldien, Klaas Bombeke

Förderung

  • Flemish Government

Zitieren

APA

Osei Tutu, D., Habibiabad, S., Van den Noortgate, W., Saldien, J., & Bombeke, K. (2025). When Action Speaks Louder than Words: Exploring Non-Verbal and Paraverbal Features in Dyadic Collaborative VR. Sensors. https://doi.org/10.3390/s25175498

Vancouver

Osei Tutu D, Habibiabad S, Van den Noortgate W, Saldien J, Bombeke K. When Action Speaks Louder than Words: Exploring Non-Verbal and Paraverbal Features in Dyadic Collaborative VR. Sensors. 2025. doi:10.3390/s25175498

BibTeX
@article{OseiTutu2025,
  author = {Osei Tutu, Dennis and Habibiabad, Sepideh and Van den Noortgate, Wim and Saldien, Jelle and Bombeke, Klaas},
  title = {When Action Speaks Louder than Words: Exploring Non-Verbal and Paraverbal Features in Dyadic Collaborative VR},
  journal = {Sensors},
  year = {2025},
  doi = {10.3390/s25175498}
}
Kostenlos starten →