Uses of Metaverse Recordings in Multimedia Information Retrieval
Multimedia · 2025
DOI: 10.3390/multimedia1010002 ↗Kurz gefasst
Fachartikel in der Zeitschrift Multimedia, 2025. Verfasst von Patrick Steinert und 3 weiteren Autor:innen. Die Arbeit nennt 61 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Metaverse Recordings (MVRs), screen recordings of user experiences in virtual environments, represent a mostly underexplored field. This article addresses the integration of MVR and Multimedia Information Retrieval (MMIR). Unlike conventional media, MVRs can include additional streams of structured data, such as Scene Raw Data (SRD) and Peripheral Data (PD), which capture graphical rendering states and user interactions. We explore the technical facets of recordings in the Metaverse, detailing diverse methodologies and their implications for MVR-specific Multimedia Information Retrieval. Our discussion not only highlights the unique opportunities of MVR content analysis, but also examines the challenges they pose to conventional MMIR paradigms. It addresses the key challenges around the semantic gap in existing content analysis tools when applied to MVRs and the high computational cost and limited recall of video-based feature extraction. We present a model for MVR structure, a prototype recording system, and an evaluation framework to assess retrieval performance. We collected a set of 111 MVRs to study and evaluate the intricacies. Our findings show that SRD and PD provide significant, low-cost contributions to retrieval accuracy and scalability, and support the case for integrating structured interaction data into future MMIR architectures.
Zitieren
APA
Steinert, P., Wagenpfeil, S., Frommholz, I., & Hemmje, M. L. (2025). Uses of Metaverse Recordings in Multimedia Information Retrieval. Multimedia. https://doi.org/10.3390/multimedia1010002
Vancouver
Steinert P, Wagenpfeil S, Frommholz I, Hemmje ML. Uses of Metaverse Recordings in Multimedia Information Retrieval. Multimedia. 2025. doi:10.3390/multimedia1010002
BibTeX
@article{Steinert2025,
author = {Steinert, Patrick and Wagenpfeil, Stefan and Frommholz, Ingo and Hemmje, Matthias L.},
title = {Uses of Metaverse Recordings in Multimedia Information Retrieval},
journal = {Multimedia},
year = {2025},
doi = {10.3390/multimedia1010002}
}
EUVIMED