EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Identifying eye movement behavior indicators of social competence during conversation listening: A study using HoloLens 2

Yu Fang, Yuichiro Fujimoto, Mitsuhiro Uratani, Isidro Butaslac, Taishi Sawabe, Masayuki Kanbara, Hirokazu Kato

Empathic Computing · 2026

DOI: 10.70401/ec.2026.0015 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Empathic Computing, 2026. Verfasst von Yu Fang und 6 weiteren Autor:innen. Die Arbeit nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Aims

This study aims to investigate the relationship between eye movement behaviors and social competence, particularly focusing on listening patterns in multi-person conversations. The goal is to identify objective, quantifiable behavioral indicators of social competence to inform the development of assessment tools and training interventions.

Methods

A three-person setting was designed with two conversational partners and one primary listener, and immersive eye-tracking data were collected using Microsoft HoloLens 2 during conversations on naturalistic topics. Social competence was rated by a clinical psychiatrist using standardized behavioral criteria, while analysis targeted three pre-selected indicators: nodding frequency, selective attention allocation to speaker’s regions of interest (head versus shoulders), and vertical gaze stability during listening.

Results

The results revealed that nodding frequency showed a strong positive correlation with social competence scores, indicating its potential as a robust nonverbal biomarker. Participants with higher social competence demonstrated greater attention to the speaker’s head region while minimizing focus on less informative areas such as the shoulders. Furthermore, individuals with higher scores exhibited significantly lower vertical gaze dispersion, reflecting more focused and stable attentional control during social listening.

Conclusion

This study establishes reliable eye movement-based indicators of social competence, highlighting their potential for assessing and enhancing social skills in real-world interactions. By integrating multimodal behavioral analysis, the findings provide a theoretical and technical foundation for developing personalized, real-time feedback systems for social competence training.

Zitieren

APA

Fang, Y., Fujimoto, Y., Uratani, M., Butaslac, I., Sawabe, T., Kanbara, M., & Kato, H. (2026). Identifying eye movement behavior indicators of social competence during conversation listening: A study using HoloLens 2. Empathic Computing. https://doi.org/10.70401/ec.2026.0015

Vancouver

Fang Y, Fujimoto Y, Uratani M, Butaslac I, Sawabe T, Kanbara M, et al. Identifying eye movement behavior indicators of social competence during conversation listening: A study using HoloLens 2. Empathic Computing. 2026. doi:10.70401/ec.2026.0015

BibTeX
@article{Fang2026,
  author = {Fang, Yu and Fujimoto, Yuichiro and Uratani, Mitsuhiro and Butaslac, Isidro and Sawabe, Taishi and Kanbara, Masayuki and Kato, Hirokazu},
  title = {Identifying eye movement behavior indicators of social competence during conversation listening: A study using HoloLens 2},
  journal = {Empathic Computing},
  year = {2026},
  doi = {10.70401/ec.2026.0015}
}
Kostenlos starten →