The Synergy Between Data and Multi-Modal Large Language Models: A Survey From Co-Development Perspective
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2025-10 · 47 (10) · 8415-8434
DOI: 10.1109/tpami.2025.3576835 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025-10. Verfasst von Zhen Qin und 7 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 283 Literaturangaben. Gefördert von: National Natural Science Foundation of China, National Key Research and Development Program of China, Zhejiang Provincial Natural Science Foundation of China.
Abstract (Originalsprache)
Recent years have witnessed the rapid development of large language models (LLMs). Multi-modal LLMs (MLLMs) extend modality from text to various domains, attracting widespread attention due to their diverse application scenarios. As LLMs and MLLMs rely on vast amounts of model parameters and data to achieve emergent capabilities, the importance of data is gaining increasing recognition. Reviewing recent data-driven works for MLLMs, we find that the development of models and data is not two separate paths but rather interconnected. Vaster and higher-quality data improve MLLM performance, while MLLMs, in turn, facilitate the development of data. The co-development of multi-modal data and MLLMs requires a clear view of 1) at which development stages of MLLMs specific data-centric approaches can be employed to enhance certain MLLM capabilities, and 2) how MLLMs, using these capabilities, can contribute to multi-modal data in specific roles. To promote data-model co-development for MLLM communities, we systematically review existing works on MLLMs from the data-model co-development perspective.
Förderung
- National Natural Science Foundation of China
- National Key Research and Development Program of China
- Zhejiang Provincial Natural Science Foundation of China
Zitieren
APA
Qin, Z., Chen, D., Zhang, W., Yao, L., Huang, Y., Ding, B., Li, Y., & Deng, S. (2025). The Synergy Between Data and Multi-Modal Large Language Models: A Survey From Co-Development Perspective. IEEE Transactions on Pattern Analysis and Machine Intelligence, 47(10), 8415-8434. https://doi.org/10.1109/tpami.2025.3576835
Vancouver
Qin Z, Chen D, Zhang W, Yao L, Huang Y, Ding B, et al. The Synergy Between Data and Multi-Modal Large Language Models: A Survey From Co-Development Perspective. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2025;47(10):8415-8434. doi:10.1109/tpami.2025.3576835
BibTeX
@article{Qin2025,
author = {Qin, Zhen and Chen, Daoyuan and Zhang, Wenhao and Yao, Liuyi and Huang, Yilun and Ding, Bolin and Li, Yaliang and Deng, Shuiguang},
title = {The Synergy Between Data and Multi-Modal Large Language Models: A Survey From Co-Development Perspective},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2025},
volume = {47},
number = {10},
pages = {8415--8434},
doi = {10.1109/tpami.2025.3576835}
}
EUVIMED