Multi-Modal AI-Based Healthcare Diagnostic and Clinical Decision Support System
International Journal of Scientific Research in Computer Science, Engineering and Information Technology · 14.11.2026 · 12 (6) · 65-80
DOI: 10.32628/cseit261269 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Scientific Research in Computer Science, Engineering and Information Technology, online erschienen am 14.11.2026. Verfasst von Naman Mishra und 2 weiteren Autor:innen. Die Arbeit nennt 83 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Medical imaging underpins modern diagnosis, yet the interpretation of scans such as brain MRI, chest radiographs, dermoscopic images, and retinal fundus photographs still depends on scarce specialist expertise, and the computational tools that support it are usually built as isolated, single-modality applications. This paper presents a Multi-Modal AI-Based Healthcare Diagnostic and Clinical Decision Support System that brings four imaging modalities into one explainable and knowledge-grounded platform. Uploaded images are standardised and analysed by a pretrained DenseNet121 backbone; Gradient-weighted Class Activation Mapping (Grad-CAM) converts the network’s internal activations into a spatial heatmap from which condition-wise scores and a leading condition are derived. The leading condition then drives a Retrieval-Augmented Generation (RAG) pipeline, built on a ChromaDB vector store with all-MiniLM-L6-v2 sentence embeddings, that returns curated findings, symptoms, and recommended clinical actions rather than freely generated text. Each analysis is logged in SQLite and can be exported as a structured PDF report through a Streamlit interface. The architecture is modular, traceable at every step, and deliberately positioned as decision support rather than a replacement for clinical judgement. We describe the design, implementation, and functional evaluation of the prototype, discuss its limitations, and outline the path toward clinically validated deployment.
Zitieren
APA
Mishra, N., Rai, A., & Perwej, Y. (2026). Multi-Modal AI-Based Healthcare Diagnostic and Clinical Decision Support System. International Journal of Scientific Research in Computer Science, Engineering and Information Technology, 12(6), 65-80. https://doi.org/10.32628/cseit261269
Vancouver
Mishra N, Rai A, Perwej Y. Multi-Modal AI-Based Healthcare Diagnostic and Clinical Decision Support System. International Journal of Scientific Research in Computer Science, Engineering and Information Technology. 2026;12(6):65-80. doi:10.32628/cseit261269
BibTeX
@article{Mishra2026,
author = {Mishra, Naman and Rai, Abhishek and Perwej, Yusuf},
title = {Multi-Modal AI-Based Healthcare Diagnostic and Clinical Decision Support System},
journal = {International Journal of Scientific Research in Computer Science, Engineering and Information Technology},
year = {2026},
volume = {12},
number = {6},
pages = {65--80},
doi = {10.32628/cseit261269}
}
EUVIMED