EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

EmoSphere++: Emotion-Controllable Zero-Shot Text-to-Speech Via Emotion-Adaptive Spherical Vector

Deok-Hyeon Cho, Hyung-Seok Oh, Seung-Bin Kim, Seong-Whan Lee

IEEE Transactions on Affective Computing · 2025-07 · 16 (3) · 2365-2380

DOI: 10.1109/taffc.2025.3561267 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Affective Computing, 2025-07. Verfasst von Deok-Hyeon Cho und 3 weiteren Autor:innen. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 72 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Emotional text-to-speech (TTS) has advanced significantly, but challenges persist due to the complexity of emotions and limitations in emotional speech datasets and models. A key issue with previous studies is the reliance on limited emotional speech datasets or extensive manual annotations, which restrict generalization across different speakers and emotional styles. To address this, we propose EmoSphere++, an emotion-controllable zero-shot TTS model capable of generating expressive speech with fine-grained control over emotional style and intensity—without requiring manual annotations. We introduce a novel emotion-adaptive spherical vector that effectively captures emotional style and intensity, along with a joint attribute style encoder that enhances generalization to both seen and unseen speakers. To further improve emotion transfer in zero-shot scenarios, we introduce an additional disentanglement method to enhance the style transfer performance for zero-shot scenarios. Through both objective and subjective evaluations, we demonstrate the benefits of the proposed model in emotion style and intensity modeling, as well as its effectiveness in enhancing emotional expressiveness across both seen and unseen speakers.

Zitieren

APA

Cho, D., Oh, H., Kim, S., & Lee, S. (2025). EmoSphere++: Emotion-Controllable Zero-Shot Text-to-Speech Via Emotion-Adaptive Spherical Vector. IEEE Transactions on Affective Computing, 16(3), 2365-2380. https://doi.org/10.1109/taffc.2025.3561267

Vancouver

Cho D, Oh H, Kim S, Lee S. EmoSphere++: Emotion-Controllable Zero-Shot Text-to-Speech Via Emotion-Adaptive Spherical Vector. IEEE Transactions on Affective Computing. 2025;16(3):2365-2380. doi:10.1109/taffc.2025.3561267

BibTeX
@article{Cho2025,
  author = {Cho, Deok-Hyeon and Oh, Hyung-Seok and Kim, Seung-Bin and Lee, Seong-Whan},
  title = {EmoSphere++: Emotion-Controllable Zero-Shot Text-to-Speech Via Emotion-Adaptive Spherical Vector},
  journal = {IEEE Transactions on Affective Computing},
  year = {2025},
  volume = {16},
  number = {3},
  pages = {2365--2380},
  doi = {10.1109/taffc.2025.3561267}
}
Kostenlos starten →