ADAPT-TTS: HIGH-QUALITY ZERO-SHOT MULTI-SPEAKER TEXT-TO-SPEECH ADAPTIVE-BASED FOR VIETNAMESE
Journal of Computer Science and Cybernetics · 2023
DOI: 10.15625/1813-9663/18136 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Computer Science and Cybernetics, 2023. Verfasst von Phuong Pham Ngoc und 2 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 27 Literaturangaben.
Abstract (Originalsprache)
Current adaptive-based speech synthesis techniques are based on two main streams: 1. Fine-tuning the model using small amounts of adaptive data, and 2. Conditionally training the entire model through a speaker embedding of the target speaker. However, both of these methods require adaptive data to appear during training, which makes the training cost to generate new voices quite expensively. In addition, the traditional TTS model uses a simple loss function to reproduce the acoustic features. However, this optimization is based on incorrect distribution assumptions leading to noisy composite audio results. We introduce the Adapt-TTS model that allows high-quality audio synthesis from a small adaptive sample without training to solve these problems. Key recommendations: 1. The Extracting Mel-vector (EMV) architecture allows for a better representation of speaker characteristics and speech style; 2. An improved zero-shot model with a denoising diffusion model (Mel-spectrogram denoiser) component allows for new voice synthesis without training with better quality (less noise). The evaluation results have proven the model's effectiveness when only needing a single utterance (1-3 seconds) of the reference speaker, the synthesis system gave high-quality synthesis results and achieved high similarity.
Zitieren
APA
Ngoc, P. P., Quang, C. T., & Chi, M. L. (2023). ADAPT-TTS: HIGH-QUALITY ZERO-SHOT MULTI-SPEAKER TEXT-TO-SPEECH ADAPTIVE-BASED FOR VIETNAMESE. Journal of Computer Science and Cybernetics. https://doi.org/10.15625/1813-9663/18136
Vancouver
Ngoc PP, Quang CT, Chi ML. ADAPT-TTS: HIGH-QUALITY ZERO-SHOT MULTI-SPEAKER TEXT-TO-SPEECH ADAPTIVE-BASED FOR VIETNAMESE. Journal of Computer Science and Cybernetics. 2023. doi:10.15625/1813-9663/18136
BibTeX
@article{Ngoc2023,
author = {Ngoc, Phuong Pham and Quang, Chung Tran and Chi, Mai Luong},
title = {ADAPT-TTS: HIGH-QUALITY ZERO-SHOT MULTI-SPEAKER TEXT-TO-SPEECH ADAPTIVE-BASED FOR VIETNAMESE},
journal = {Journal of Computer Science and Cybernetics},
year = {2023},
doi = {10.15625/1813-9663/18136}
}
EUVIMED