A Cross-Modal Retrieval Framework for Radiology Reports and Chest X-Ray Images
Engineering, Technology & Applied Science Research · 04.04.2026 · 16 (2) · 33196-33201
DOI: 10.48084/etasr.17163 ↗Kurz gefasst
Fachartikel in der Zeitschrift Engineering, Technology & Applied Science Research, online erschienen am 04.04.2026. Verfasst von Vijayalaxmi Mekali und 7 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 15 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Accurate retrieval of relevant radiology reports and images is essential for clinical decision support and large-scale medical data management. This study proposes MedFuse-CLIP, a domain-tuned cross-modal retrieval framework that aligns chest X-ray images with corresponding radiology reports using a dual-encoder OpenCLIP ViT-B/32 backbone. The model introduces two key innovations: adaptive semantic hard-negative mining, which enhances discriminative learning across visually similar pathologies, and a retrieval-aware margin contrastive loss, which stabilizes alignment within the embedding space. Experiments on the MIMIC-CXR-JPG dataset demonstrate strong performance, achieving Recall@10 scores of 87.5% for image→text retrieval and 83.4% for text→image retrieval under fine-tuned cross-modal alignment, along with an average AUROC of 0.879 for zero-shot disease classification across 14 thoracic pathologies. Dimensionality reduction analysis confirmed that compact 256-dimensional embeddings preserve more than 98% of retrieval accuracy while halving storage requirements. The results indicate that MedFuse-CLIP matches or exceeds existing radiology vision-language models such as BioViL and GLoRIA while operating efficiently on a single consumer GPU.
Zitieren
APA
Mekali, V., Sowbhagya, M. P., Aparna, H. D., Mathew, D. K., Singh, V., Nikam, N. N., Dongre, G. B., & Bhosale, Y. H. (2026). A Cross-Modal Retrieval Framework for Radiology Reports and Chest X-Ray Images. Engineering, Technology & Applied Science Research, 16(2), 33196-33201. https://doi.org/10.48084/etasr.17163
Vancouver
Mekali V, Sowbhagya MP, Aparna HD, Mathew DK, Singh V, Nikam NN, et al. A Cross-Modal Retrieval Framework for Radiology Reports and Chest X-Ray Images. Engineering, Technology & Applied Science Research. 2026;16(2):33196-33201. doi:10.48084/etasr.17163
BibTeX
@article{Mekali2026,
author = {Mekali, Vijayalaxmi and Sowbhagya, M. P. and Aparna, H. D. and Mathew, Deepa K. and Singh, Vandana and Nikam, Nitesh N. and Dongre, Ganesh B. and Bhosale, Yogesh H.},
title = {A Cross-Modal Retrieval Framework for Radiology Reports and Chest X-Ray Images},
journal = {Engineering, Technology & Applied Science Research},
year = {2026},
volume = {16},
number = {2},
pages = {33196--33201},
doi = {10.48084/etasr.17163}
}
EUVIMED