EUVIMEDEUVIMED entdecken
Crossref

Eliciting user interaction though the incremental confirmation of user understanding using multimodal cues

Mao Saeki, Masaki Eguchi, Yoichi Matsuyama, Tetsunori Kobayashi

Dialogue & Discourse · 23.07.2026 · 17 (2) · 53-93

DOI: 10.5210/dad.2026.202 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Dialogue & Discourse, online erschienen am 23.07.2026. Verfasst von Mao Saeki und 3 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We propose and evaluate a suite of dialogue strategies designed to elicit user-initiated interaction in multimodal dialogue systems. Effective communication relies on active contributions from all participants; however, users interacting with dialogue systems often exhibit less engagement compared to human–human interactions. We hypothesize that this discrepancy arises from the lack of incremental confirmation of user understanding by the system, depriving the user from opportunity to show interaction. To address this, we introduce a strategy that incrementally confirms user understanding though lexical, acoustic, temporal, and visual cues. We implement this strategy in a multimodal dialogue system and conduct a comparative study against a baseline system without the strategy. User interaction behaviors were analyzed using objectively measurable features. Results demonstrate that our approach significantly enhances user interaction, as evidenced by increased frequencies of backchanneling (+22.0%), turn exchanges (+11.2%), and number of questions (+25.8%). Notably, the system elicits active user participation, reflected in more questions and frequent turn exchanges, going beyond the backchannel-oriented engagement achieved in prior studies. Furthermore, we examine correlations between these behavioral metrics and users’ subjective evaluations of engagement.

Zitieren

APA

Saeki, M., Eguchi, M., Matsuyama, Y., & Kobayashi, T. (2026). Eliciting user interaction though the incremental confirmation of user understanding using multimodal cues. Dialogue & Discourse, 17(2), 53-93. https://doi.org/10.5210/dad.2026.202

Vancouver

Saeki M, Eguchi M, Matsuyama Y, Kobayashi T. Eliciting user interaction though the incremental confirmation of user understanding using multimodal cues. Dialogue & Discourse. 2026;17(2):53-93. doi:10.5210/dad.2026.202

BibTeX
@article{Saeki2026,
  author = {Saeki, Mao and Eguchi, Masaki and Matsuyama, Yoichi and Kobayashi, Tetsunori},
  title = {Eliciting user interaction though the incremental confirmation of user understanding using multimodal cues},
  journal = {Dialogue & Discourse},
  year = {2026},
  volume = {17},
  number = {2},
  pages = {53--93},
  doi = {10.5210/dad.2026.202}
}
Kostenlos starten →