ContactVision: Learning Foot Contact from Video for Physically Plausible Gait Animation
Computer Graphics Forum · 24.03.2026
DOI: 10.1111/cgf.70334 ↗Kurz gefasst
Fachartikel in der Zeitschrift Computer Graphics Forum, online erschienen am 24.03.2026. Verfasst von Daeyong Kim und 2 weiteren Autor:innen. Die Arbeit nennt 52 Literaturangaben. Gefördert von: Ministry of Science and ICT, South Korea, National IT Industry Promotion Agency.
Abstract (Originalsprache)
Foot‐ground contact information plays a crucial role in character animation and gait analysis, as it helps accurately simulating realistic movement patterns and understanding the biomechanics of walking. Existing motion datasets do not explicitly include foot‐ground contact information, requiring separate computation or manual annotation. Obtaining accurate foot‐ground contact information typically requires additional sensors such as pressure mats or force plates. Without such devices, estimating contact becomes a highly challenging task. We propose ContactVision, a deep learning framework that detects heel and toe contact states directly from video. Our network is trained in a supervised manner using contact labels derived from motion capture data via ground reaction force estimation. This enables training on existing datasets without the need for additional hardware. We demonstrate the utility of our contact detection network in two downstream tasks: gait motion reconstruction and gait analysis. For animation, we incorporate predicted contact labels into a reinforcement learning framework with a two‐segment foot model, enabling realistic foot articulation behavior. For analysis, we estimate clinically relevant gait parameters such as double and single support times, and validate the accuracy against pressure sensor mat data and prior video‐based methods. Our results show competitive performance in both animation and analysis settings. The code is publicly available at github.com/DaeeYong/ContactVision .
Förderung
- Ministry of Science and ICT, South Korea
- National IT Industry Promotion Agency
Zitieren
APA
Kim, D., Yi, G., & Yu, R. (2026). ContactVision: Learning Foot Contact from Video for Physically Plausible Gait Animation. Computer Graphics Forum. https://doi.org/10.1111/cgf.70334
Vancouver
Kim D, Yi G, Yu R. ContactVision: Learning Foot Contact from Video for Physically Plausible Gait Animation. Computer Graphics Forum. 2026. doi:10.1111/cgf.70334
BibTeX
@article{Kim2026,
author = {Kim, Daeyong and Yi, Gyuseok and Yu, Ri},
title = {ContactVision: Learning Foot Contact from Video for Physically Plausible Gait Animation},
journal = {Computer Graphics Forum},
year = {2026},
doi = {10.1111/cgf.70334}
}
EUVIMED