Do statistical patterns in neural audio codec tokens by synthesized speech reveal structure beyond speech quality?
The Journal of the Acoustical Society of America · 01.10.2025 · 158 (4_Supplement) · A196-A196
DOI: 10.1121/10.0040578 ↗Kurz gefasst
Fachartikel in der Zeitschrift The Journal of the Acoustical Society of America, erschienen am 01.10.2025. Verfasst von Joonyong Park und 5 weiteren Autor:innen.
Abstract (Originalsprache)
We investigate whether statistical regularities in discrete speech token sequences emerge before perceptual quality is achieved in speech synthesis. Using a Neural Audio Codec (NAC), we extract discrete token sequences from both natural human speech and synthetic speech generated at various training checkpoints of text-to-speech (TTS) models. Interestingly, NAC token distributions in synthetic speech resemble those of natural speech, even at early stages when outputs are unintelligible or babble-like. Across all training checkpoints, the tokens follow Zipf’s law consistently, while Heaps’ law shows milder but stable trends. These findings suggest that latent linguistic structures may begin to emerge in symbolic representations of synthetic speech, even before the models produce perceptually natural or intelligible outputs. This token-level stability contrasts with significant perceptual improvements observed across training stages, indicating that NAC tokens can reflect early structural convergence. We propose that such statistical regularities in NAC tokens offer a novel signal for early-stage model analysis or speech authenticity inspection, prior to conventional semantic or acoustic evaluations. Our work highlights the value of symbolic token analysis in understanding the internal dynamics of speech synthesis models and points toward lightweight, interpretable evaluation tools grounded in linguistic statistics.
Zitieren
APA
Park, J., Takamichi, S., Chan, D. M., Kando, S., Saito, Y., & Saruwatari, H. (2025). Do statistical patterns in neural audio codec tokens by synthesized speech reveal structure beyond speech quality?. The Journal of the Acoustical Society of America, 158(4_Supplement), A196-A196. https://doi.org/10.1121/10.0040578
Vancouver
Park J, Takamichi S, Chan DM, Kando S, Saito Y, Saruwatari H. Do statistical patterns in neural audio codec tokens by synthesized speech reveal structure beyond speech quality?. The Journal of the Acoustical Society of America. 2025;158(4_Supplement):A196-A196. doi:10.1121/10.0040578
BibTeX
@article{Park2025,
author = {Park, Joonyong and Takamichi, Shinnosuke and Chan, David M. and Kando, Shunsuke and Saito, Yuki and Saruwatari, Hiroshi},
title = {Do statistical patterns in neural audio codec tokens by synthesized speech reveal structure beyond speech quality?},
journal = {The Journal of the Acoustical Society of America},
year = {2025},
volume = {158},
number = {4_Supplement},
pages = {A196--A196},
doi = {10.1121/10.0040578}
}
EUVIMED