SSGesture: Multimodal Gesture Generation Framework for Human Animation Synthesis
IEEE Computer Graphics and Applications · 2025
DOI: 10.1109/mcg.2025.3577477 ↗Kurz gefasst
Evaluationsstudie in der Zeitschrift IEEE Computer Graphics and Applications, 2025. Verfasst von Xinyi Wang und 2 weiteren Autor:innen. Hauptthemen laut MEDLINE: Computer Graphics, Generative Artificial Intelligence, Gestures, Image Processing, Computer-Assisted.
Abstract (Originalsprache)
Technological innovations are reshaping the development of animation production. As virtual characters are increasingly used in animation creation and smart assistants, a key challenge is how to automatically generate dialogue gestures. However, current approaches often overlook a wide range of modalities and their interactions, resulting in gestures that have low contextual variation and noticeable jitter. To address these issues, we propose SSGesture, a novel diffusion-based framework that effectively captures cross-modal associations. Our three-layer attention structure enhances multimodal processing. We propose the first method to automatically resolve style conflicts through interpolation-based gesture style control, while implementing a unified unmarked style prompt structure via the prompt-aligned adaptive normalization layer. Our framework is practically applied in the field of intelligent virtual assistants to generate gestures in human animation synthesis and to realize various new applications. Extensive experiments and user studies have demonstrated that our proposed framework provides substantial assistance in enhancing the efficiency of human animation production.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Zitieren
APA
Wang, X., Liu, S., & Yang, X. (2025). SSGesture: Multimodal Gesture Generation Framework for Human Animation Synthesis. IEEE Computer Graphics and Applications. https://doi.org/10.1109/mcg.2025.3577477
Vancouver
Wang X, Liu S, Yang X. SSGesture: Multimodal Gesture Generation Framework for Human Animation Synthesis. IEEE Computer Graphics and Applications. 2025. doi:10.1109/mcg.2025.3577477
BibTeX
@article{Wang2025,
author = {Wang, Xinyi and Liu, Shiguang and Yang, Xu},
title = {SSGesture: Multimodal Gesture Generation Framework for Human Animation Synthesis},
journal = {IEEE Computer Graphics and Applications},
year = {2025},
doi = {10.1109/mcg.2025.3577477}
}
EUVIMED