EUVIMEDOpdag EUVIMED
Open access · CC BY 4.0

Uses of Metaverse Recordings in Multimedia Information Retrieval

Patrick Steinert, Stefan Wagenpfeil, Ingo Frommholz, Matthias L. Hemmje

Multimedia · 2025

DOI: 10.3390/multimedia1010002 ↗

At a glance

Journal article in Multimedia, 2025. Written by Patrick Steinert and 3 co-authors. 61 references. The full text is freely available (open access, CC BY 4.0).

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Metaverse Recordings (MVRs), screen recordings of user experiences in virtual environments, represent a mostly underexplored field. This article addresses the integration of MVR and Multimedia Information Retrieval (MMIR). Unlike conventional media, MVRs can include additional streams of structured data, such as Scene Raw Data (SRD) and Peripheral Data (PD), which capture graphical rendering states and user interactions. We explore the technical facets of recordings in the Metaverse, detailing diverse methodologies and their implications for MVR-specific Multimedia Information Retrieval. Our discussion not only highlights the unique opportunities of MVR content analysis, but also examines the challenges they pose to conventional MMIR paradigms. It addresses the key challenges around the semantic gap in existing content analysis tools when applied to MVRs and the high computational cost and limited recall of video-based feature extraction. We present a model for MVR structure, a prototype recording system, and an evaluation framework to assess retrieval performance. We collected a set of 111 MVRs to study and evaluate the intricacies. Our findings show that SRD and PD provide significant, low-cost contributions to retrieval accuracy and scalability, and support the case for integrating structured interaction data into future MMIR architectures.

Cite

APA

Steinert, P., Wagenpfeil, S., Frommholz, I., & Hemmje, M. L. (2025). Uses of Metaverse Recordings in Multimedia Information Retrieval. Multimedia. https://doi.org/10.3390/multimedia1010002

Vancouver

Steinert P, Wagenpfeil S, Frommholz I, Hemmje ML. Uses of Metaverse Recordings in Multimedia Information Retrieval. Multimedia. 2025. doi:10.3390/multimedia1010002

BibTeX
@article{Steinert2025,
  author = {Steinert, Patrick and Wagenpfeil, Stefan and Frommholz, Ingo and Hemmje, Matthias L.},
  title = {Uses of Metaverse Recordings in Multimedia Information Retrieval},
  journal = {Multimedia},
  year = {2025},
  doi = {10.3390/multimedia1010002}
}
Start for free →