EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Cross-Modal Retrieval Framework for Radiology Reports and Chest X-Ray Images

Vijayalaxmi Mekali, M. P. Sowbhagya, H. D. Aparna, Deepa K. Mathew, Vandana Singh, Nitesh N. Nikam, Ganesh B. Dongre, Yogesh H. Bhosale

Engineering, Technology & Applied Science Research · 04.04.2026 · 16 (2) · 33196-33201

DOI: 10.48084/etasr.17163 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Engineering, Technology & Applied Science Research, online erschienen am 04.04.2026. Verfasst von Vijayalaxmi Mekali und 7 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 15 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Accurate retrieval of relevant radiology reports and images is essential for clinical decision support and large-scale medical data management. This study proposes MedFuse-CLIP, a domain-tuned cross-modal retrieval framework that aligns chest X-ray images with corresponding radiology reports using a dual-encoder OpenCLIP ViT-B/32 backbone. The model introduces two key innovations: adaptive semantic hard-negative mining, which enhances discriminative learning across visually similar pathologies, and a retrieval-aware margin contrastive loss, which stabilizes alignment within the embedding space. Experiments on the MIMIC-CXR-JPG dataset demonstrate strong performance, achieving Recall@10 scores of 87.5% for image→text retrieval and 83.4% for text→image retrieval under fine-tuned cross-modal alignment, along with an average AUROC of 0.879 for zero-shot disease classification across 14 thoracic pathologies. Dimensionality reduction analysis confirmed that compact 256-dimensional embeddings preserve more than 98% of retrieval accuracy while halving storage requirements. The results indicate that MedFuse-CLIP matches or exceeds existing radiology vision-language models such as BioViL and GLoRIA while operating efficiently on a single consumer GPU.

Zitieren

APA

Mekali, V., Sowbhagya, M. P., Aparna, H. D., Mathew, D. K., Singh, V., Nikam, N. N., Dongre, G. B., & Bhosale, Y. H. (2026). A Cross-Modal Retrieval Framework for Radiology Reports and Chest X-Ray Images. Engineering, Technology & Applied Science Research, 16(2), 33196-33201. https://doi.org/10.48084/etasr.17163

Vancouver

Mekali V, Sowbhagya MP, Aparna HD, Mathew DK, Singh V, Nikam NN, et al. A Cross-Modal Retrieval Framework for Radiology Reports and Chest X-Ray Images. Engineering, Technology & Applied Science Research. 2026;16(2):33196-33201. doi:10.48084/etasr.17163

BibTeX
@article{Mekali2026,
  author = {Mekali, Vijayalaxmi and Sowbhagya, M. P. and Aparna, H. D. and Mathew, Deepa K. and Singh, Vandana and Nikam, Nitesh N. and Dongre, Ganesh B. and Bhosale, Yogesh H.},
  title = {A Cross-Modal Retrieval Framework for Radiology Reports and Chest X-Ray Images},
  journal = {Engineering, Technology & Applied Science Research},
  year = {2026},
  volume = {16},
  number = {2},
  pages = {33196--33201},
  doi = {10.48084/etasr.17163}
}
Kostenlos starten →