EUVIMEDEUVIMED entdecken
Crossref

Target-speaker automatic speech recognition with dual-mode training

Li Li, Koichi Miyazaki, Shogo Seki, Naoki Sawada

The Journal of the Acoustical Society of America · 01.10.2025 · 158 (4_Supplement) · A174-A174

DOI: 10.1121/10.0040512 ↗

Kurz gefasst

Fachartikel in der Zeitschrift The Journal of the Acoustical Society of America, erschienen am 01.10.2025. Verfasst von Li Li und 3 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Target-speaker automatic speech recognition (TS-ASR) is a critical technology for transcribing a specific speaker's voice in multi-talker environments. By providing target speaker clues, it can also improve performance in noisy single-speaker situations. Conventionally, TS-ASR models are designed for either high-accuracy offline (batch) processing or low-latency real-time (streaming) inference, requiring separate models for different applications. This approach is inefficient, increasing development and maintenance overhead. This paper introduces a dual-mode training framework to TS-ASR that enables a single model to operate effectively in both streaming and batch modes. During training, both modes are executed simultaneously, compelling the model to learn robust representations that are effective with limited and complete future context. This approach potentially enriches the streaming mode's performance. We explore both a cascaded model that integrates target speaker extraction (TSE) with ASR and an end-to-end system. The proposed framework is evaluated using the LibriMix benchmark, demonstrating its capability to create a flexible and resource-efficient TS-ASR system.

Zitieren

APA

Li, L., Miyazaki, K., Seki, S., & Sawada, N. (2025). Target-speaker automatic speech recognition with dual-mode training. The Journal of the Acoustical Society of America, 158(4_Supplement), A174-A174. https://doi.org/10.1121/10.0040512

Vancouver

Li L, Miyazaki K, Seki S, Sawada N. Target-speaker automatic speech recognition with dual-mode training. The Journal of the Acoustical Society of America. 2025;158(4_Supplement):A174-A174. doi:10.1121/10.0040512

BibTeX
@article{Li2025,
  author = {Li, Li and Miyazaki, Koichi and Seki, Shogo and Sawada, Naoki},
  title = {Target-speaker automatic speech recognition with dual-mode training},
  journal = {The Journal of the Acoustical Society of America},
  year = {2025},
  volume = {158},
  number = {4_Supplement},
  pages = {A174--A174},
  doi = {10.1121/10.0040512}
}
Kostenlos starten →