EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

State of the Art in Dense Monocular Non‐Rigid 3D Reconstruction

Edith Tretschk, Navami Kairanda, Mallikarjun B R, Rishabh Dabral, Adam Kortylewski, Bernhard Egger, Marc Habermann, Pascal Fua, Christian Theobalt, Vladislav Golyanik

Computer Graphics Forum · 2023-05 · 42 (2) · 485-520

DOI: 10.1111/cgf.14774 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computer Graphics Forum, online erschienen am 23.05.2023. Verfasst von Edith Tretschk und 9 weiteren Autor:innen. Die Arbeit wurde bisher 39-mal zitiert (Crossref) und nennt 338 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: Deutsche Forschungsgemeinschaft.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

3D reconstruction of deformable (or non‐rigid ) scenes from a set of monocular 2D image observations is a long‐standing and actively researched area of computer vision and graphics. It is an ill‐posed inverse problem, since—without additional prior assumptions—it permits infinitely many solutions leading to accurate projection to the input 2D images. Non‐rigid reconstruction is a foundational building block for downstream applications like robotics, AR/VR, or visual content creation. The key advantage of using monocular cameras is their omnipresence and availability to the end users as well as their ease of use compared to more sophisticated camera set‐ups such as stereo or multi‐view systems. This survey focuses on state‐of‐the‐art methods for dense non‐rigid 3D reconstruction of various deformable objects and composite scenes from monocular videos or sets of monocular views. It reviews the fundamentals of 3D reconstruction and deformation modeling from 2D image observations. We then start from general methods—that handle arbitrary scenes and make only a few prior assumptions—and proceed towards techniques making stronger assumptions about the observed objects and types of deformations (e.g. human faces, bodies, hands, and animals). A significant part of this STAR is also devoted to classification and a high‐level comparison of the methods, as well as an overview of the datasets for training and evaluation of the discussed techniques. We conclude by discussing open challenges in the field and the social aspects associated with the usage of the reviewed methods.

Förderung

  • Deutsche Forschungsgemeinschaft

Zitieren

APA

Tretschk, E., Kairanda, N., R, M. B., Dabral, R., Kortylewski, A., Egger, B., Habermann, M., Fua, P., Theobalt, C., & Golyanik, V. (2023). State of the Art in Dense Monocular Non‐Rigid 3D Reconstruction. Computer Graphics Forum, 42(2), 485-520. https://doi.org/10.1111/cgf.14774

Vancouver

Tretschk E, Kairanda N, R MB, Dabral R, Kortylewski A, Egger B, et al. State of the Art in Dense Monocular Non‐Rigid 3D Reconstruction. Computer Graphics Forum. 2023;42(2):485-520. doi:10.1111/cgf.14774

BibTeX
@article{Tretschk2023,
  author = {Tretschk, Edith and Kairanda, Navami and R, Mallikarjun B and Dabral, Rishabh and Kortylewski, Adam and Egger, Bernhard and Habermann, Marc and Fua, Pascal and Theobalt, Christian and Golyanik, Vladislav},
  title = {State of the Art in Dense Monocular Non‐Rigid 3D Reconstruction},
  journal = {Computer Graphics Forum},
  year = {2023},
  volume = {42},
  number = {2},
  pages = {485--520},
  doi = {10.1111/cgf.14774}
}
Kostenlos starten →