EUVIMEDEUVIMED entdecken
Crossref

The Synergy Between Data and Multi-Modal Large Language Models: A Survey From Co-Development Perspective

Zhen Qin, Daoyuan Chen, Wenhao Zhang, Liuyi Yao, Yilun Huang, Bolin Ding, Yaliang Li, Shuiguang Deng

IEEE Transactions on Pattern Analysis and Machine Intelligence · 2025-10 · 47 (10) · 8415-8434

DOI: 10.1109/tpami.2025.3576835 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025-10. Verfasst von Zhen Qin und 7 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 283 Literaturangaben. Gefördert von: National Natural Science Foundation of China, National Key Research and Development Program of China, Zhejiang Provincial Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recent years have witnessed the rapid development of large language models (LLMs). Multi-modal LLMs (MLLMs) extend modality from text to various domains, attracting widespread attention due to their diverse application scenarios. As LLMs and MLLMs rely on vast amounts of model parameters and data to achieve emergent capabilities, the importance of data is gaining increasing recognition. Reviewing recent data-driven works for MLLMs, we find that the development of models and data is not two separate paths but rather interconnected. Vaster and higher-quality data improve MLLM performance, while MLLMs, in turn, facilitate the development of data. The co-development of multi-modal data and MLLMs requires a clear view of 1) at which development stages of MLLMs specific data-centric approaches can be employed to enhance certain MLLM capabilities, and 2) how MLLMs, using these capabilities, can contribute to multi-modal data in specific roles. To promote data-model co-development for MLLM communities, we systematically review existing works on MLLMs from the data-model co-development perspective.

Förderung

  • National Natural Science Foundation of China
  • National Key Research and Development Program of China
  • Zhejiang Provincial Natural Science Foundation of China

Zitieren

APA

Qin, Z., Chen, D., Zhang, W., Yao, L., Huang, Y., Ding, B., Li, Y., & Deng, S. (2025). The Synergy Between Data and Multi-Modal Large Language Models: A Survey From Co-Development Perspective. IEEE Transactions on Pattern Analysis and Machine Intelligence, 47(10), 8415-8434. https://doi.org/10.1109/tpami.2025.3576835

Vancouver

Qin Z, Chen D, Zhang W, Yao L, Huang Y, Ding B, et al. The Synergy Between Data and Multi-Modal Large Language Models: A Survey From Co-Development Perspective. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2025;47(10):8415-8434. doi:10.1109/tpami.2025.3576835

BibTeX
@article{Qin2025,
  author = {Qin, Zhen and Chen, Daoyuan and Zhang, Wenhao and Yao, Liuyi and Huang, Yilun and Ding, Bolin and Li, Yaliang and Deng, Shuiguang},
  title = {The Synergy Between Data and Multi-Modal Large Language Models: A Survey From Co-Development Perspective},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year = {2025},
  volume = {47},
  number = {10},
  pages = {8415--8434},
  doi = {10.1109/tpami.2025.3576835}
}
Kostenlos starten →