Spolacq-GDS: A generative dialogue simulator for spoken interaction learning
The Journal of the Acoustical Society of America · 01.10.2025 · 158 (4_Supplement) · A260-A260
DOI: 10.1121/10.0040820 ↗Kurz gefasst
Fachartikel in der Zeitschrift The Journal of the Acoustical Society of America, erschienen am 01.10.2025. Verfasst von Taisei Awashima und 5 weiteren Autor:innen.
Abstract (Originalsprache)
We propose Spolacq-GDS, a spoken dialogue simulator designed to support spoken interaction learning in multimodal environments. Dialogue scenarios are flexibly defined using human-readable finite-state automata, in which each state represents a dialogue scene and triggers dynamic generation of speech and visual context via pretrained generative models. This enables richly interactive simulations without requiring task-specific datasets. While large language models like ChatGPT are often fine-tuned using reinforcement learning from human feedback (RLHF), rewards are typically assigned to isolated, single-turn outputs or single-step actions. As a result, such models lack interactive learning loops with the environment and user state, limiting their ability to acquire goal-directed behavior through experience. Simulators such as EmoUS enhance user realism through emotion modeling but remain restricted to text-only interactions and fixed task flows. Spolacq-GDS addresses these limitations by providing a data-free, customizable spoken-dialogue simulation environment implemented within the Gymnasium reinforcement learning framework. It supports integration with both reinforcement learning and self-supervised learning agents. We demonstrate that previously studied spoken language acquisition tasks and newly designed multimodal scenarios can be implemented using only text-based scenario descriptions, making Spolacq-GDS a practical platform for exploring motivation-driven spoken interaction in richly simulated environments.
Zitieren
APA
Awashima, T., Toyosaki, R., Mikuriya, K., Kawakita, K., Li, S., & Shinozaki, T. (2025). Spolacq-GDS: A generative dialogue simulator for spoken interaction learning. The Journal of the Acoustical Society of America, 158(4_Supplement), A260-A260. https://doi.org/10.1121/10.0040820
Vancouver
Awashima T, Toyosaki R, Mikuriya K, Kawakita K, Li S, Shinozaki T. Spolacq-GDS: A generative dialogue simulator for spoken interaction learning. The Journal of the Acoustical Society of America. 2025;158(4_Supplement):A260-A260. doi:10.1121/10.0040820
BibTeX
@article{Awashima2025,
author = {Awashima, Taisei and Toyosaki, Renon and Mikuriya, Koki and Kawakita, Kota and Li, Sheng and Shinozaki, Takahiro},
title = {Spolacq-GDS: A generative dialogue simulator for spoken interaction learning},
journal = {The Journal of the Acoustical Society of America},
year = {2025},
volume = {158},
number = {4_Supplement},
pages = {A260--A260},
doi = {10.1121/10.0040820}
}
EUVIMED