EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Evaluating Dense Model-based Approaches for Multimodal Medical Case Retrieval

Catarina Pires, Sérgio Nunes, Luís Filipe Teixeira

Information Retrieval Research · 2025

DOI: 10.54195/irrj.19769 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Information Retrieval Research, 2025. Verfasst von Catarina Pires und 2 weiteren Autor:innen. Die Arbeit nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Medical case retrieval plays a crucial role in clinical decision-making by enabling healthcare professionals to find relevant cases based on patient records, diagnostic images, and textual descriptions. Given the inherently multimodal nature of medical data, effective retrieval requires models that can bridge the gap between different modalities. Traditional retrieval approaches often rely on unimodal representations, limiting their ability to capture cross-modal relationships. Recent advances in dense model-based techniques have shown promise in overcoming these limitations by encoding multimodal information into a shared latent space, facilitating retrieval based on semantic similarity. This paper investigates the potential of dense models to enhance multimodal search systems. We evaluate various dense model-based approaches to assess which model characteristics have the greatest impact on retrieval effectiveness, using the medical case-based retrieval task from ImageCLEFmed 2013 as a benchmark. Our findings indicate that different dense model approaches substantially impact retrieval effectiveness, and that applying the CombMAX fusion method to combine their output results further improves effectiveness. Extending context length, however, yielded mixed results depending on the input data. Additionally, domain-specific models—those trained on medical data—outperformed general models trained on broad, non-specialized datasets within their respective fields. Furthermore, when text is the dominant information source, text-only models surpassed multimodal models

Zitieren

APA

Pires, C., Nunes, S., & Teixeira, L. F. (2025). Evaluating Dense Model-based Approaches for Multimodal Medical Case Retrieval. Information Retrieval Research. https://doi.org/10.54195/irrj.19769

Vancouver

Pires C, Nunes S, Teixeira LF. Evaluating Dense Model-based Approaches for Multimodal Medical Case Retrieval. Information Retrieval Research. 2025. doi:10.54195/irrj.19769

BibTeX
@article{Pires2025,
  author = {Pires, Catarina and Nunes, Sérgio and Teixeira, Luís Filipe},
  title = {Evaluating Dense Model-based Approaches for Multimodal Medical Case Retrieval},
  journal = {Information Retrieval Research},
  year = {2025},
  doi = {10.54195/irrj.19769}
}
Kostenlos starten →