Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Survey
ACM Computing Surveys · 31.08.2025 · 57 (8) · 1-36
DOI: 10.1145/3711680 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Computing Surveys, online erschienen am 05.03.2025. Verfasst von Jiayi Kuang und 9 weiteren Autor:innen. Die Arbeit wurde bisher 72-mal zitiert (Crossref) und nennt 196 Literaturangaben.
Abstract (Originalsprache)
Visual Question Answering (VQA) is a challenge task that combines natural language processing and computer vision techniques and gradually becomes a benchmark test task in multimodal large language models (MLLMs). The goal of our survey is to provide an overview of the development of VQA and a detailed description of the latest models with high timeliness. This survey gives an up-to-date synthesis of natural language understanding of images and text, as well as the knowledge reasoning module based on image-question information on the core VQA tasks. In addition, we elaborate on recent advances in extracting and fusing modal information with vision-language pretraining models and multimodal large language models in VQA. We also exhaustively review the progress of knowledge reasoning in VQA by detailing the extraction of internal knowledge and the introduction of external knowledge. Finally, we present the datasets of VQA and different evaluation metrics and discuss possible directions for future work.
Zitieren
APA
Kuang, J., Shen, Y., Xie, J., Luo, H., Xu, Z., Li, R., Li, Y., Cheng, X., Lin, X., & Han, Y. (2025). Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Survey. ACM Computing Surveys, 57(8), 1-36. https://doi.org/10.1145/3711680
Vancouver
Kuang J, Shen Y, Xie J, Luo H, Xu Z, Li R, et al. Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Survey. ACM Computing Surveys. 2025;57(8):1-36. doi:10.1145/3711680
BibTeX
@article{Kuang2025,
author = {Kuang, Jiayi and Shen, Ying and Xie, Jingyou and Luo, Haohao and Xu, Zhe and Li, Ronghao and Li, Yinghui and Cheng, Xianfeng and Lin, Xika and Han, Yu},
title = {Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Survey},
journal = {ACM Computing Surveys},
year = {2025},
volume = {57},
number = {8},
pages = {1--36},
doi = {10.1145/3711680}
}
EUVIMED