Multimodal RAG Based System to Handle Financial Documents
International Journal of Innovative Science and Research Technology · 15.06.2026 · 4345
DOI: 10.38124/ijisrt/26may2022 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Innovative Science and Research Technology, online erschienen am 15.06.2026. Verfasst von Rucha Dhage und 1 weiteren Autor:innen. Die Arbeit nennt 15 Literaturangaben.
Abstract (Originalsprache)
Traditional Retrieval-Augmented Generation (RAG) systems are very effective at querying text-based documents, but real-world documents are not just text based, they are complex and contain images, graphs, tables and more. Thus, traditional text only based RAG systems struggle to process such multimodal documents that contain more than just text effectively. This project presents the development of a Multimodal RAG system which is designed to bridge this gap. By Utilizing LangChain, HuggingFace embeddings, ChromaDB, and the LLaVA 1.5 Vision-Language Model (VLM), the system processes documents that contains not just text, but images and tabular data as well and extracts textual and visual elements such as images and graphs, and answers user queries based on both text and visual information. By indexing both textual and visual summaries into a unified vector space, the system retrieves multimodal context and gives accurate, grounded responses while reducing hallucinations related to chart colors and visual data trends.
Zitieren
APA
Dhage, R., & Bharati, M. (2026). Multimodal RAG Based System to Handle Financial Documents. International Journal of Innovative Science and Research Technology, 4345. https://doi.org/10.38124/ijisrt/26may2022
Vancouver
Dhage R, Bharati M. Multimodal RAG Based System to Handle Financial Documents. International Journal of Innovative Science and Research Technology. 2026:4345. doi:10.38124/ijisrt/26may2022
BibTeX
@article{Dhage2026,
author = {Dhage, Rucha and Bharati, Manisha},
title = {Multimodal RAG Based System to Handle Financial Documents},
journal = {International Journal of Innovative Science and Research Technology},
year = {2026},
pages = {4345},
doi = {10.38124/ijisrt/26may2022}
}
EUVIMED