EUVIMEDEUVIMED entdecken
Crossref

Subjective and Objective Quality Assessment of Rendered Human Avatar Videos in Virtual Reality

Yu-Chih Chen, Avinab Saha, Alexandre Chapiro, Christian Hane, Jean-Charles Bazin, Bo Qiu, Stefano Zanetti, Ioannis Katsavounidis, Alan C Bovik

IEEE Transactions on Image Processing · 2024

DOI: 10.1109/tip.2024.3468881 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Image Processing, 2024. Verfasst von Yu-Chih Chen und 8 weiteren Autor:innen. Hauptthemen laut MEDLINE: Video Recording, Virtual Reality, Algorithms, Image Processing, Computer-Assisted. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 80 Literaturangaben. Gefördert von: Meta Platforms Inc. The work of Alan C. Bovik was supported by the National Science Foundation AI Institute for Foundations of Machine Learning.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We study the visual quality judgments of human subjects on digital human avatars (sometimes referred to as "holograms" in the parlance of virtual reality [VR] and augmented reality [AR] systems) that have been subjected to distortions. We also study the ability of video quality models to predict human judgments. As streaming human avatar videos in VR or AR become increasingly common, the need for more advanced human avatar video compression protocols will be required to address the tradeoffs between faithfully transmitting high-quality visual representations while adjusting to changeable bandwidth scenarios. During transmission over the internet, the perceived quality of compressed human avatar videos can be severely impaired by visual artifacts. To optimize trade-offs between perceptual quality and data volume in practical workflows, video quality assessment (VQA) models are essential tools. However, there are very few VQA algorithms developed specifically to analyze human body avatar videos, due, at least in part, to the dearth of appropriate and comprehensive datasets of adequate size. Towards filling this gap, we introduce the LIVE-Meta Rendered Human Avatar VQA Database, which contains 720 human avatar videos processed using 20 different combinations of encoding parameters, labeled by corresponding human perceptual quality judgments that were collected in six degrees of freedom VR headsets. To demonstrate the usefulness of this new and unique video resource, we use it to study and compare the performances of a variety of state-of-the-art Full Reference and No Reference video quality prediction models, including a new model called HoloQA. As a service to the research community, we publicly releases the metadata of the new database at https://live.ece.utexas.edu/research/LIVE-Meta-rendered-human-avatar/index.html.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Video RecordingVirtual RealityAlgorithmsImage Processing, Computer-AssistedHumansAvatar

Förderung

  • Meta Platforms Inc. The work of Alan C. Bovik was supported by the National Science Foundation AI Institute for Foundations of Machine Learning

Zitieren

APA

Chen, Y. C., Saha, A., Chapiro, A., Hane, C., Bazin, J. C., Qiu, B., Zanetti, S., Katsavounidis, I., & Bovik, A. C. (2024). Subjective and Objective Quality Assessment of Rendered Human Avatar Videos in Virtual Reality. IEEE Transactions on Image Processing. https://doi.org/10.1109/tip.2024.3468881

Vancouver

Chen YC, Saha A, Chapiro A, Hane C, Bazin JC, Qiu B, et al. Subjective and Objective Quality Assessment of Rendered Human Avatar Videos in Virtual Reality. IEEE Transactions on Image Processing. 2024. doi:10.1109/tip.2024.3468881

BibTeX
@article{Chen2024,
  author = {Chen, Yu-Chih and Saha, Avinab and Chapiro, Alexandre and Hane, Christian and Bazin, Jean-Charles and Qiu, Bo and Zanetti, Stefano and Katsavounidis, Ioannis and Bovik, Alan C},
  title = {Subjective and Objective Quality Assessment of Rendered Human Avatar Videos in Virtual Reality},
  journal = {IEEE Transactions on Image Processing},
  year = {2024},
  doi = {10.1109/tip.2024.3468881}
}
Kostenlos starten →