EUVIMEDEUVIMED entdecken
Crossref

Reconstructing Close Human Interactions from Multiple Views

Qing Shuai, Zhiyuan Yu, Zhize Zhou, Lixin Fan, Haijun Yang, Can Yang, Xiaowei Zhou

ACM Transactions on Graphics · 05.12.2023 · 42 (6) · 1-14

DOI: 10.1145/3618336 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Graphics, online erschienen am 05.12.2023. Verfasst von Qing Shuai und 6 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 74 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper addresses the challenging task of reconstructing the poses of multiple individuals engaged in close interactions, captured by multiple calibrated cameras. The difficulty arises from the noisy or false 2D keypoint detections due to inter-person occlusion, the heavy ambiguity in associating keypoints to individuals due to the close interactions, and the scarcity of training data as collecting and annotating motion data in crowded scenes is resource-intensive. We introduce a novel system to address these challenges. Our system integrates a learning-based pose estimation component and its corresponding training and inference strategies. The pose estimation component takes multi-view 2D keypoint heatmaps as input and reconstructs the pose of each individual using a 3D conditional volumetric network. As the network doesn't need images as input, we can leverage known camera parameters from test scenes and a large quantity of existing motion capture data to synthesize massive training data that mimics the real data distribution in test scenes. Extensive experiments demonstrate that our approach significantly surpasses previous approaches in terms of pose accuracy and is generalizable across various camera setups and population sizes. The code is available on our project page: https://github.com/zju3dv/CloseMoCap.

Zitieren

APA

Shuai, Q., Yu, Z., Zhou, Z., Fan, L., Yang, H., Yang, C., & Zhou, X. (2023). Reconstructing Close Human Interactions from Multiple Views. ACM Transactions on Graphics, 42(6), 1-14. https://doi.org/10.1145/3618336

Vancouver

Shuai Q, Yu Z, Zhou Z, Fan L, Yang H, Yang C, et al. Reconstructing Close Human Interactions from Multiple Views. ACM Transactions on Graphics. 2023;42(6):1-14. doi:10.1145/3618336

BibTeX
@article{Shuai2023,
  author = {Shuai, Qing and Yu, Zhiyuan and Zhou, Zhize and Fan, Lixin and Yang, Haijun and Yang, Can and Zhou, Xiaowei},
  title = {Reconstructing Close Human Interactions from Multiple Views},
  journal = {ACM Transactions on Graphics},
  year = {2023},
  volume = {42},
  number = {6},
  pages = {1--14},
  doi = {10.1145/3618336}
}
Kostenlos starten →