PropGesture: Few‐shot Co‐speech Gesture Synthesis for Handheld Props
Computer Graphics Forum · 13.11.2026
DOI: 10.1111/cgf.70603 ↗Kurz gefasst
Fachartikel in der Zeitschrift Computer Graphics Forum, online erschienen am 13.11.2026. Verfasst von Jiho Kang und 3 weiteren Autor:innen. Die Arbeit nennt 77 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: Ministry of Science and ICT, South Korea.
Abstract (Originalsprache)
While co‐speech gesture synthesis has made significant progress in generating natural full‐body motion from speech, a frequent setting where characters hold objects while speaking remains largely underexplored. The core challenge is that motion capture data cannot be collected at scale for every possible object, making few‐shot adaptation a practical necessity. Yet a handful of samples is hard to exploit: conditioning on them as motion examples imposes only a soft prior, yielding intermittent object‐aware behavior, while finetuning the full model on them either overfits and loses gesture diversity or fails to produce stable, prop‐appropriate motion on the holding arm. To address this, we present PropGesture, a few‐shot framework that adapts to a target prop using a small set of example clips synthesized by a video generation model. Our key design is to localize object adaptation to the prop‐holding arm, preserving gesture diversity while introducing object‐specific dynamics locally. Specifically, a phase‐based arm motion generator, pretrained on large‐scale gesture data and finetuned on the example clips, resolves the many‐to‐many speech–gesture ambiguity through phase sampling and retrieves arm motion via motion matching. This arm motion is then inpainted into a pretrained gesture flow matching model that synthesizes the remaining body from speech. We demonstrate the effectiveness of our method through both perceptual and quantitative comparisons against motion‐example‐based and finetuning‐based baselines. Source code and dataset are available at our project page.
Förderung
- Ministry of Science and ICT, South Korea
Zitieren
APA
Kang, J., Choi, J., Shin, J., & Lee, S. (2026). PropGesture: Few‐shot Co‐speech Gesture Synthesis for Handheld Props. Computer Graphics Forum. https://doi.org/10.1111/cgf.70603
Vancouver
Kang J, Choi J, Shin J, Lee S. PropGesture: Few‐shot Co‐speech Gesture Synthesis for Handheld Props. Computer Graphics Forum. 2026. doi:10.1111/cgf.70603
BibTeX
@article{Kang2026,
author = {Kang, Jiho and Choi, Junghoon and Shin, Jihun and Lee, Sung‐Hee},
title = {PropGesture: Few‐shot Co‐speech Gesture Synthesis for Handheld Props},
journal = {Computer Graphics Forum},
year = {2026},
doi = {10.1111/cgf.70603}
}
EUVIMED