Speech synthesis with perceptual rating-guided parallel iterative decoding
The Journal of the Acoustical Society of America · 01.10.2025 · 158 (4_Supplement) · A467-A467
DOI: 10.1121/10.0041552 ↗Kurz gefasst
Fachartikel in der Zeitschrift The Journal of the Acoustical Society of America, erschienen am 01.10.2025. Verfasst von Kazuki Yamauchi und 2 weiteren Autor:innen.
Abstract (Originalsprache)
We explore inference-time optimization strategies to improve text-to-speech (TTS) systems by leveraging automatic perceptual assessment of synthetic speech. Recent advances in non-autoregressive TTS based on parallel iterative decoding have demonstrated strong capabilities in prosodic diversity, duration controllability, and robustness. These models typically generate discrete speech tokens—extracted from speech self-supervised learning models or neural audio codec models—by iteratively unmasking them based on computed generation probabilities. However, selecting tokens to unmask solely based on generation probability does not always yield perceptually optimal speech quality. To address this limitation, we propose a novel decoding strategy that incorporates perceptual speech assessment into the token selection process, guiding selection toward tokens that optimize perceptual ratings at inference time. Specifically, we introduce a best-of-K sampling strategy, in which multiple candidate tokens are sampled and evaluated using a learned perceptual rating predictor; the tokens with the highest predicted rating are selected for unmasking. We investigate three variants of this strategy: (1) iterative application at each unmasking step, (2) one-shot application after the entire unmasking process, and (3) a hybrid approach combining both. Subjective evaluations demonstrate that applying our method to a state-of-the-art zero-shot TTS model improves both the naturalness and speaker similarity of synthetic speech.
Zitieren
APA
Yamauchi, K., Saito, Y., & Saruwatari, H. (2025). Speech synthesis with perceptual rating-guided parallel iterative decoding. The Journal of the Acoustical Society of America, 158(4_Supplement), A467-A467. https://doi.org/10.1121/10.0041552
Vancouver
Yamauchi K, Saito Y, Saruwatari H. Speech synthesis with perceptual rating-guided parallel iterative decoding. The Journal of the Acoustical Society of America. 2025;158(4_Supplement):A467-A467. doi:10.1121/10.0041552
BibTeX
@article{Yamauchi2025,
author = {Yamauchi, Kazuki and Saito, Yuki and Saruwatari, Hiroshi},
title = {Speech synthesis with perceptual rating-guided parallel iterative decoding},
journal = {The Journal of the Acoustical Society of America},
year = {2025},
volume = {158},
number = {4_Supplement},
pages = {A467--A467},
doi = {10.1121/10.0041552}
}
EUVIMED