Evaluating Dense Model-based Approaches for Multimodal Medical Case Retrieval
Information Retrieval Research · 2025
DOI: 10.54195/irrj.19769 ↗Kurz gefasst
Fachartikel in der Zeitschrift Information Retrieval Research, 2025. Verfasst von Catarina Pires und 2 weiteren Autor:innen. Die Arbeit nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Medical case retrieval plays a crucial role in clinical decision-making by enabling healthcare professionals to find relevant cases based on patient records, diagnostic images, and textual descriptions. Given the inherently multimodal nature of medical data, effective retrieval requires models that can bridge the gap between different modalities. Traditional retrieval approaches often rely on unimodal representations, limiting their ability to capture cross-modal relationships. Recent advances in dense model-based techniques have shown promise in overcoming these limitations by encoding multimodal information into a shared latent space, facilitating retrieval based on semantic similarity. This paper investigates the potential of dense models to enhance multimodal search systems. We evaluate various dense model-based approaches to assess which model characteristics have the greatest impact on retrieval effectiveness, using the medical case-based retrieval task from ImageCLEFmed 2013 as a benchmark. Our findings indicate that different dense model approaches substantially impact retrieval effectiveness, and that applying the CombMAX fusion method to combine their output results further improves effectiveness. Extending context length, however, yielded mixed results depending on the input data. Additionally, domain-specific models—those trained on medical data—outperformed general models trained on broad, non-specialized datasets within their respective fields. Furthermore, when text is the dominant information source, text-only models surpassed multimodal models
Zitieren
APA
Pires, C., Nunes, S., & Teixeira, L. F. (2025). Evaluating Dense Model-based Approaches for Multimodal Medical Case Retrieval. Information Retrieval Research. https://doi.org/10.54195/irrj.19769
Vancouver
Pires C, Nunes S, Teixeira LF. Evaluating Dense Model-based Approaches for Multimodal Medical Case Retrieval. Information Retrieval Research. 2025. doi:10.54195/irrj.19769
BibTeX
@article{Pires2025,
author = {Pires, Catarina and Nunes, Sérgio and Teixeira, Luís Filipe},
title = {Evaluating Dense Model-based Approaches for Multimodal Medical Case Retrieval},
journal = {Information Retrieval Research},
year = {2025},
doi = {10.54195/irrj.19769}
}
EUVIMED