A Robust Two-Stage Retrieval-Augmented Vision-Language Framework for Knowledge-Intensive Multimodal Reasoning and Alignment
Computational Discovery and Intelligent Systems (CDIS) · 05.02.2026 · 2 (2) · 42-52
DOI: 10.66279/2da0zk02 ↗Kurz gefasst
Fachartikel in der Zeitschrift Computational Discovery and Intelligent Systems (CDIS), online erschienen am 05.02.2026. Verfasst von Prashant Johri Johri und 5 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Vision-Language Models (VLMs) have demonstrated significant potential in visual perception and linguistic understanding. However, they often struggle with knowledge-intensive tasks that require linking visual scenes to external background knowledge. To address these limitations, this paper proposes the RoRA-VLM (Robust Retrieval-Augmented Vision Language Model) framework. RoRA-VLM introduces a novel two-stage retrieval mechanism—Image-anchored Textual-query Expansion—to bridge the modality discrepancy between visual and textual inputs. Furthermore, it incorporates a Query-oriented Visual Token Refinement strategy for better alignment and Adversarial Noise Injection to enhance reasoning robustness against irrelevant retrieved information. Experimental results on the InfoSeek and OVEN datasets demonstrate that RoRA-VLM significantly outperforms baseline models, achieving a 62.5% accuracy on InfoSeek, which represents a 17.3% improvement over the base LLaVA-v1.5 model. These findings highlight the effectiveness of the proposed alignment and reasoning mechanisms in developing more intelligent and robust vision-language systems.
Zitieren
APA
Johri, P. J., Asiri, A. A., Assery, E. A., Hassan, S., Emad, E., & Abdelrahman, E. (2026). A Robust Two-Stage Retrieval-Augmented Vision-Language Framework for Knowledge-Intensive Multimodal Reasoning and Alignment. Computational Discovery and Intelligent Systems (CDIS), 2(2), 42-52. https://doi.org/10.66279/2da0zk02
Vancouver
Johri PJ, Asiri AA, Assery EA, Hassan S, Emad E, Abdelrahman E. A Robust Two-Stage Retrieval-Augmented Vision-Language Framework for Knowledge-Intensive Multimodal Reasoning and Alignment. Computational Discovery and Intelligent Systems (CDIS). 2026;2(2):42-52. doi:10.66279/2da0zk02
BibTeX
@article{Johri2026,
author = {Johri, Prashant Johri and Asiri, Arwa Abdulrahman and Assery, Ebtehal Abdulrahman and Hassan, Sohila and Emad, Esraa and Abdelrahman, Esraa},
title = {A Robust Two-Stage Retrieval-Augmented Vision-Language Framework for Knowledge-Intensive Multimodal Reasoning and Alignment},
journal = {Computational Discovery and Intelligent Systems (CDIS)},
year = {2026},
volume = {2},
number = {2},
pages = {42--52},
doi = {10.66279/2da0zk02}
}
EUVIMED