MOCHI: Motion Enhancement of Collaborative Human-object Interactions
ACM Transactions on Graphics · 03.07.2026 · 45 (4) · 1-18
DOI: 10.1145/3811308 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Graphics, online erschienen am 03.07.2026. Verfasst von Jiye Lee und 2 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 90 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Research Foundation of Korea, Institute of Information & Communications Technology Planning & Evaluation.
Abstract (Originalsprache)
Collaborative human-object interaction shows dynamic and complex movements that require mutual anticipation and continuous adjustment between participants and the shared object. Understanding and modeling such collaborative multi-human object interaction (MHOI) scenarios requires high-quality data acquisition as a foundational step, however, this is a challenging task due to the inherent complexity of MHOI scenarios where human-human and human-object interactions occur simultaneously. Such complexity leads to noisy MHOI captures characterized by several artifacts: contact misalignment between hands and objects, motion jitter and temporal inconsistencies in the captured sequences, and missing or incomplete finger-level articulation details. To address these challenges, we present MOCHI (MOtion Enhancement of Collaborative Human-object Interactions), a two-stage framework for enhancing noisy MHOI data. Our approach first generates physically plausible hand grasps through optimization from noisy body input, producing grasps that are both physically plausible and semantically consistent with the body pose, where these optimized grasps are extended into complete hand-object interaction sequences. Consequently, the full-body motion for all participants are refined through a diffusion-based noise optimization framework that uses single-person motion priors. During the optimization process, we introduce optimization objectives to encode human-object and human-human interaction information within these single-person priors. Experimental results demonstrate the effectiveness of our pipeline across diverse MHOI data, either acquired by existing capture methods or synthesized by generative models. We further show robustness of our system across varying numbers of participants and types of interactions, and demonstrate various applications including keyframe-based MHOI creation and data augmentation through varying object geometries.
Förderung
- National Research Foundation of Korea
- Institute of Information & Communications Technology Planning & Evaluation
Zitieren
APA
Lee, J., Choi, Y., & Won, J. (2026). MOCHI: Motion Enhancement of Collaborative Human-object Interactions. ACM Transactions on Graphics, 45(4), 1-18. https://doi.org/10.1145/3811308
Vancouver
Lee J, Choi Y, Won J. MOCHI: Motion Enhancement of Collaborative Human-object Interactions. ACM Transactions on Graphics. 2026;45(4):1-18. doi:10.1145/3811308
BibTeX
@article{Lee2026,
author = {Lee, Jiye and Choi, Yonghun and Won, Jungdam},
title = {MOCHI: Motion Enhancement of Collaborative Human-object Interactions},
journal = {ACM Transactions on Graphics},
year = {2026},
volume = {45},
number = {4},
pages = {1--18},
doi = {10.1145/3811308}
}
EUVIMED