EUVIMEDEUVIMED entdecken
Crossref

Spolacq-GDS: A generative dialogue simulator for spoken interaction learning

Taisei Awashima, Renon Toyosaki, Koki Mikuriya, Kota Kawakita, Sheng Li, Takahiro Shinozaki

The Journal of the Acoustical Society of America · 01.10.2025 · 158 (4_Supplement) · A260-A260

DOI: 10.1121/10.0040820 ↗

Kurz gefasst

Fachartikel in der Zeitschrift The Journal of the Acoustical Society of America, erschienen am 01.10.2025. Verfasst von Taisei Awashima und 5 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We propose Spolacq-GDS, a spoken dialogue simulator designed to support spoken interaction learning in multimodal environments. Dialogue scenarios are flexibly defined using human-readable finite-state automata, in which each state represents a dialogue scene and triggers dynamic generation of speech and visual context via pretrained generative models. This enables richly interactive simulations without requiring task-specific datasets. While large language models like ChatGPT are often fine-tuned using reinforcement learning from human feedback (RLHF), rewards are typically assigned to isolated, single-turn outputs or single-step actions. As a result, such models lack interactive learning loops with the environment and user state, limiting their ability to acquire goal-directed behavior through experience. Simulators such as EmoUS enhance user realism through emotion modeling but remain restricted to text-only interactions and fixed task flows. Spolacq-GDS addresses these limitations by providing a data-free, customizable spoken-dialogue simulation environment implemented within the Gymnasium reinforcement learning framework. It supports integration with both reinforcement learning and self-supervised learning agents. We demonstrate that previously studied spoken language acquisition tasks and newly designed multimodal scenarios can be implemented using only text-based scenario descriptions, making Spolacq-GDS a practical platform for exploring motivation-driven spoken interaction in richly simulated environments.

Zitieren

APA

Awashima, T., Toyosaki, R., Mikuriya, K., Kawakita, K., Li, S., & Shinozaki, T. (2025). Spolacq-GDS: A generative dialogue simulator for spoken interaction learning. The Journal of the Acoustical Society of America, 158(4_Supplement), A260-A260. https://doi.org/10.1121/10.0040820

Vancouver

Awashima T, Toyosaki R, Mikuriya K, Kawakita K, Li S, Shinozaki T. Spolacq-GDS: A generative dialogue simulator for spoken interaction learning. The Journal of the Acoustical Society of America. 2025;158(4_Supplement):A260-A260. doi:10.1121/10.0040820

BibTeX
@article{Awashima2025,
  author = {Awashima, Taisei and Toyosaki, Renon and Mikuriya, Koki and Kawakita, Kota and Li, Sheng and Shinozaki, Takahiro},
  title = {Spolacq-GDS: A generative dialogue simulator for spoken interaction learning},
  journal = {The Journal of the Acoustical Society of America},
  year = {2025},
  volume = {158},
  number = {4_Supplement},
  pages = {A260--A260},
  doi = {10.1121/10.0040820}
}
Kostenlos starten →