EUVIMEDEUVIMED entdecken
Crossref

ADAPT-TTS: HIGH-QUALITY ZERO-SHOT MULTI-SPEAKER TEXT-TO-SPEECH ADAPTIVE-BASED FOR VIETNAMESE

Phuong Pham Ngoc, Chung Tran Quang, Mai Luong Chi

Journal of Computer Science and Cybernetics · 2023

DOI: 10.15625/1813-9663/18136 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Computer Science and Cybernetics, 2023. Verfasst von Phuong Pham Ngoc und 2 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 27 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Current adaptive-based speech synthesis techniques are based on two main streams: 1. Fine-tuning the model using small amounts of adaptive data, and 2. Conditionally training the entire model through a speaker embedding of the target speaker. However, both of these methods require adaptive data to appear during training, which makes the training cost to generate new voices quite expensively. In addition, the traditional TTS model uses a simple loss function to reproduce the acoustic features. However, this optimization is based on incorrect distribution assumptions leading to noisy composite audio results. We introduce the Adapt-TTS model that allows high-quality audio synthesis from a small adaptive sample without training to solve these problems. Key recommendations: 1. The Extracting Mel-vector (EMV) architecture allows for a better representation of speaker characteristics and speech style; 2. An improved zero-shot model with a denoising diffusion model (Mel-spectrogram denoiser) component allows for new voice synthesis without training with better quality (less noise). The evaluation results have proven the model's effectiveness when only needing a single utterance (1-3 seconds) of the reference speaker, the synthesis system gave high-quality synthesis results and achieved high similarity.

Zitieren

APA

Ngoc, P. P., Quang, C. T., & Chi, M. L. (2023). ADAPT-TTS: HIGH-QUALITY ZERO-SHOT MULTI-SPEAKER TEXT-TO-SPEECH ADAPTIVE-BASED FOR VIETNAMESE. Journal of Computer Science and Cybernetics. https://doi.org/10.15625/1813-9663/18136

Vancouver

Ngoc PP, Quang CT, Chi ML. ADAPT-TTS: HIGH-QUALITY ZERO-SHOT MULTI-SPEAKER TEXT-TO-SPEECH ADAPTIVE-BASED FOR VIETNAMESE. Journal of Computer Science and Cybernetics. 2023. doi:10.15625/1813-9663/18136

BibTeX
@article{Ngoc2023,
  author = {Ngoc, Phuong Pham and Quang, Chung Tran and Chi, Mai Luong},
  title = {ADAPT-TTS: HIGH-QUALITY ZERO-SHOT MULTI-SPEAKER TEXT-TO-SPEECH ADAPTIVE-BASED FOR VIETNAMESE},
  journal = {Journal of Computer Science and Cybernetics},
  year = {2023},
  doi = {10.15625/1813-9663/18136}
}
Kostenlos starten →