Performance Evaluation in Multimedia Retrieval
ACM Transactions on Multimedia Computing, Communications, and Applications · 31.01.2025 · 21 (1) · 1-23
DOI: 10.1145/3678881 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Multimedia Computing, Communications, and Applications, online erschienen am 23.12.2024. Verfasst von Loris Sauter und 4 weiteren Autor:innen. Die Arbeit wurde bisher 23-mal zitiert (Crossref) und nennt 52 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Swiss National Science Foundation.
Abstract (Originalsprache)
Performance evaluation in multimedia retrieval, as in the information retrieval domain at large, relies heavily on retrieval experiments, employing a broad range of techniques and metrics. These can involve human-in-the-loop and machine-only settings for the retrieval process itself and the subsequent verification of results. Such experiments can be elaborate and use-case-specific, which can make them difficult to compare or replicate. In this article, we present a formal model to express all relevant aspects of such retrieval experiments, as well as a flexible open-source evaluation infrastructure that implements the model. These contributions intend to make a step towards lowering the hurdles for conducting retrieval experiments and improving their reproducibility.
Förderung
- Swiss National Science Foundation
Zitieren
APA
Sauter, L., Gasser, R., Schuldt, H., Bernstein, A., & Rossetto, L. (2025). Performance Evaluation in Multimedia Retrieval. ACM Transactions on Multimedia Computing, Communications, and Applications, 21(1), 1-23. https://doi.org/10.1145/3678881
Vancouver
Sauter L, Gasser R, Schuldt H, Bernstein A, Rossetto L. Performance Evaluation in Multimedia Retrieval. ACM Transactions on Multimedia Computing, Communications, and Applications. 2025;21(1):1-23. doi:10.1145/3678881
BibTeX
@article{Sauter2025,
author = {Sauter, Loris and Gasser, Ralph and Schuldt, Heiko and Bernstein, Abraham and Rossetto, Luca},
title = {Performance Evaluation in Multimedia Retrieval},
journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
year = {2025},
volume = {21},
number = {1},
pages = {1--23},
doi = {10.1145/3678881}
}
EUVIMED