EUVIMEDEUVIMED entdecken
Crossref

Multi-talker conversational speech generation for training speaker diarization model via text-to-speech

Keigo Ichikawa, Sei Ueno, Akinobu Lee

The Journal of the Acoustical Society of America · 01.10.2025 · 158 (4_Supplement) · A137-A137

DOI: 10.1121/10.0040375 ↗

Kurz gefasst

Fachartikel in der Zeitschrift The Journal of the Acoustical Society of America, erschienen am 01.10.2025. Verfasst von Keigo Ichikawa und 2 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Speaker diarization is a task that estimates “who spoke when” from multi-talker audio. Recent advancements in end-to-end models have significantly improved diarization performance, especially for overlapping speech. However, these models require a large amount of annotated multi-talker audio data for training. Such annotated datasets are limited, and manual annotation is highly costly. Therefore, previous studies generate training data by artificially concatenating segments from recorded audio. Nevertheless, these methods largely rely on recorded audio, with little consideration given to the content of the spoken utterances. The utterances are often contextually unrelated. In this work, we propose a data generation method using text-to-speech (TTS) synthesis, which enables the preparation of speech from arbitrary text. Leveraging TTS enables the generation of audio with flexible utterance lengths and speech quantity. Furthermore, by using multi-speaker conversational text, it becomes possible to generate multi-talker conversational speech that preserves context across utterances. Through experimental evaluations, we will investigate how training audio duration, per-speaker speech quantity, and contextual coherence impact diarization performance. We aim to show that TTS-based data generation can effectively improve speaker diarization performance.

Zitieren

APA

Ichikawa, K., Ueno, S., & Lee, A. (2025). Multi-talker conversational speech generation for training speaker diarization model via text-to-speech. The Journal of the Acoustical Society of America, 158(4_Supplement), A137-A137. https://doi.org/10.1121/10.0040375

Vancouver

Ichikawa K, Ueno S, Lee A. Multi-talker conversational speech generation for training speaker diarization model via text-to-speech. The Journal of the Acoustical Society of America. 2025;158(4_Supplement):A137-A137. doi:10.1121/10.0040375

BibTeX
@article{Ichikawa2025,
  author = {Ichikawa, Keigo and Ueno, Sei and Lee, Akinobu},
  title = {Multi-talker conversational speech generation for training speaker diarization model via text-to-speech},
  journal = {The Journal of the Acoustical Society of America},
  year = {2025},
  volume = {158},
  number = {4_Supplement},
  pages = {A137--A137},
  doi = {10.1121/10.0040375}
}
Kostenlos starten →