EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

AlzheimerRAG: Multimodal Retrieval-Augmented Generation for Clinical Use Cases

Aritra Kumar Lahiri, Qinmin Vivian Hu

Machine Learning and Knowledge Extraction · 27.08.2025 · 7 (3) · 89

DOI: 10.3390/make7030089 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Machine Learning and Knowledge Extraction, online erschienen am 27.08.2025. Verfasst von Aritra Kumar Lahiri und 1 weiteren Autor:innen. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 84 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Natural Sciences and Engineering Research Council of Canada (NSERC).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recent advancements in generative AI have fostered the development of highly adept Large Language Models (LLMs) that integrate diverse data types to empower decision-making. Among these, multimodal retrieval-augmented generation (RAG) applications are promising because they combine the strengths of information retrieval and generative models, enhancing their utility across various domains, including clinical use cases. This paper introduces AlzheimerRAG, a multimodal RAG application for clinical use cases, primarily focusing on Alzheimer’s disease case studies from PubMed articles. This application incorporates cross-modal attention fusion techniques to integrate textual and visual data processing by efficiently indexing and accessing vast amounts of biomedical literature. Our experimental results, compared to benchmarks such as BioASQ and PubMedQA, yield improved performance in the retrieval and synthesis of domain-specific information. We also present a case study using our multimodal RAG in various Alzheimer’s clinical scenarios. We infer that AlzheimerRAG can generate responses with accuracy non-inferior to humans and with low rates of hallucination.

Förderung

  • Natural Sciences and Engineering Research Council of Canada (NSERC)

Zitieren

APA

Lahiri, A. K., & Hu, Q. V. (2025). AlzheimerRAG: Multimodal Retrieval-Augmented Generation for Clinical Use Cases. Machine Learning and Knowledge Extraction, 7(3), 89. https://doi.org/10.3390/make7030089

Vancouver

Lahiri AK, Hu QV. AlzheimerRAG: Multimodal Retrieval-Augmented Generation for Clinical Use Cases. Machine Learning and Knowledge Extraction. 2025;7(3):89. doi:10.3390/make7030089

BibTeX
@article{Lahiri2025,
  author = {Lahiri, Aritra Kumar and Hu, Qinmin Vivian},
  title = {AlzheimerRAG: Multimodal Retrieval-Augmented Generation for Clinical Use Cases},
  journal = {Machine Learning and Knowledge Extraction},
  year = {2025},
  volume = {7},
  number = {3},
  pages = {89},
  doi = {10.3390/make7030089}
}
Kostenlos starten →