EUVIMEDEUVIMED entdecken
Evaluationsstudie

SSGesture: Multimodal Gesture Generation Framework for Human Animation Synthesis

Xinyi Wang, Shiguang Liu, Xu Yang

IEEE Computer Graphics and Applications · 2025

DOI: 10.1109/mcg.2025.3577477 ↗

Kurz gefasst

Evaluationsstudie in der Zeitschrift IEEE Computer Graphics and Applications, 2025. Verfasst von Xinyi Wang und 2 weiteren Autor:innen. Hauptthemen laut MEDLINE: Computer Graphics, Generative Artificial Intelligence, Gestures, Image Processing, Computer-Assisted.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Technological innovations are reshaping the development of animation production. As virtual characters are increasingly used in animation creation and smart assistants, a key challenge is how to automatically generate dialogue gestures. However, current approaches often overlook a wide range of modalities and their interactions, resulting in gestures that have low contextual variation and noticeable jitter. To address these issues, we propose SSGesture, a novel diffusion-based framework that effectively captures cross-modal associations. Our three-layer attention structure enhances multimodal processing. We propose the first method to automatically resolve style conflicts through interpolation-based gesture style control, while implementing a unified unmarked style prompt structure via the prompt-aligned adaptive normalization layer. Our framework is practically applied in the field of intelligent virtual assistants to generate gestures in human animation synthesis and to realize various new applications. Extensive experiments and user studies have demonstrated that our proposed framework provides substantial assistance in enhancing the efficiency of human animation production.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Computer GraphicsGenerative Artificial IntelligenceGesturesImage Processing, Computer-AssistedIntelligent SystemsHumansUser-Computer InterfaceSemantics

Zitieren

APA

Wang, X., Liu, S., & Yang, X. (2025). SSGesture: Multimodal Gesture Generation Framework for Human Animation Synthesis. IEEE Computer Graphics and Applications. https://doi.org/10.1109/mcg.2025.3577477

Vancouver

Wang X, Liu S, Yang X. SSGesture: Multimodal Gesture Generation Framework for Human Animation Synthesis. IEEE Computer Graphics and Applications. 2025. doi:10.1109/mcg.2025.3577477

BibTeX
@article{Wang2025,
  author = {Wang, Xinyi and Liu, Shiguang and Yang, Xu},
  title = {SSGesture: Multimodal Gesture Generation Framework for Human Animation Synthesis},
  journal = {IEEE Computer Graphics and Applications},
  year = {2025},
  doi = {10.1109/mcg.2025.3577477}
}
Kostenlos starten →