Real-Time Interaction for 3D Pixel Human in Virtual Environment
Applied Sciences · 11.01.2023 · 13 (2) · 966
DOI: 10.3390/app13020966 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 11.01.2023. Verfasst von Haoke Deng und 3 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Institute of Information & Communications Technology Planning & Evaluation (IITP), National Research Foundation of Korea.
Abstract (Originalsprache)
Conducting realistic interactions while communicating efficiently in online conferences is highly desired but challenging. In this work, we propose a novel pixel-style virtual avatar for interacting with virtual objects in virtual conferences that can be generated in real-time. It consists of a 2D segmented head video stream for real-time facial expressions and a 3D point cloud body for realistic interactions, both of which are generated from RGB video input of a monocular webcam. We obtain a human-only video stream with a human matting method and generate the 3D avatar’s arms with a 3D pose estimation method, which improves the stereoscopic realism and sense of interaction of conference participants while interacting with virtual objects. Our approach fills the gap between 2D video conferences and 3D virtual avatars and combines the advantages of both. We evaluated our pixel-style avatar by conducting a user study; the result proved that the efficiency of our method is superior to other various existing avatar types.
Förderung
- Institute of Information & Communications Technology Planning & Evaluation (IITP)
- National Research Foundation of Korea
Zitieren
APA
Deng, H., Zhang, Q., Jin, H., & Kim, C. (2023). Real-Time Interaction for 3D Pixel Human in Virtual Environment. Applied Sciences, 13(2), 966. https://doi.org/10.3390/app13020966
Vancouver
Deng H, Zhang Q, Jin H, Kim C. Real-Time Interaction for 3D Pixel Human in Virtual Environment. Applied Sciences. 2023;13(2):966. doi:10.3390/app13020966
BibTeX
@article{Deng2023,
author = {Deng, Haoke and Zhang, Qimeng and Jin, Hongyu and Kim, Chang-Hun},
title = {Real-Time Interaction for 3D Pixel Human in Virtual Environment},
journal = {Applied Sciences},
year = {2023},
volume = {13},
number = {2},
pages = {966},
doi = {10.3390/app13020966}
}
EUVIMED