IMoS: Intent‐Driven Full‐Body Motion Synthesis for Human‐Object Interactions
Computer Graphics Forum · 2023-05 · 42 (2) · 1-12
DOI: 10.1111/cgf.14739 ↗Kurz gefasst
Fachartikel in der Zeitschrift Computer Graphics Forum, online erschienen am 23.05.2023. Verfasst von Anindita Ghosh und 4 weiteren Autor:innen. Die Arbeit wurde bisher 104-mal zitiert (Crossref) und nennt 74 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Bundesministerium für Bildung und Forschung, ITEA, Horizon 2020 Framework Programme.
Abstract (Originalsprache)
Can we make virtual characters in a scene interact with their surrounding objects through simple instructions? Is it possible to synthesize such motion plausibly with a diverse set of objects and instructions? Inspired by these questions, we present the first framework to synthesize the full‐body motion of virtual human characters performing specified actions with 3D objects placed within their reach. Our system takes textual instructions specifying the objects and the associated ‘intentions’ of the virtual characters as input and outputs diverse sequences of full‐body motions. This contrasts existing works, where full‐body action synthesis methods generally do not consider object interactions, and human‐object interaction methods focus mainly on synthesizing hand or finger movements for grasping objects. We accomplish our objective by designing an intent‐driven full‐body motion generator, which uses a pair of decoupled conditional variational auto‐regressors to learn the motion of the body parts in an autoregressive manner. We also optimize the 6‐DoF pose of the objects such that they plausibly fit within the hands of the synthesized characters. We compare our proposed method with the existing methods of motion synthesis and establish a new and stronger state‐of‐the‐art for the task of intent‐driven motion synthesis.
Förderung
- Bundesministerium für Bildung und Forschung
- ITEA
- Horizon 2020 Framework Programme
- H2020 European Research Council
Zitieren
APA
Ghosh, A., Dabral, R., Golyanik, V., Theobalt, C., & Slusallek, P. (2023). IMoS: Intent‐Driven Full‐Body Motion Synthesis for Human‐Object Interactions. Computer Graphics Forum, 42(2), 1-12. https://doi.org/10.1111/cgf.14739
Vancouver
Ghosh A, Dabral R, Golyanik V, Theobalt C, Slusallek P. IMoS: Intent‐Driven Full‐Body Motion Synthesis for Human‐Object Interactions. Computer Graphics Forum. 2023;42(2):1-12. doi:10.1111/cgf.14739
BibTeX
@article{Ghosh2023,
author = {Ghosh, Anindita and Dabral, Rishabh and Golyanik, Vladislav and Theobalt, Christian and Slusallek, Philipp},
title = {IMoS: Intent‐Driven Full‐Body Motion Synthesis for Human‐Object Interactions},
journal = {Computer Graphics Forum},
year = {2023},
volume = {42},
number = {2},
pages = {1--12},
doi = {10.1111/cgf.14739}
}
EUVIMED