From Large Language Models to Large Multimodal Models: A Literature Review
Applied Sciences · 11.06.2024 · 14 (12) · 5068
DOI: 10.3390/app14125068 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 11.06.2024. Verfasst von Dawei Huang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 109-mal zitiert (Crossref) und nennt 182 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Stable Support Projects for Shenzhen Higher Education Institutions, Natural Science Foundation of Top Talent of SZTU.
Abstract (Originalsprache)
With the deepening of research on Large Language Models (LLMs), significant progress has been made in recent years on the development of Large Multimodal Models (LMMs), which are gradually moving toward Artificial General Intelligence. This paper aims to summarize the recent progress from LLMs to LMMs in a comprehensive and unified way. First, we start with LLMs and outline various conceptual frameworks and key techniques. Then, we focus on the architectural components, training strategies, fine-tuning guidance, and prompt engineering of LMMs, and present a taxonomy of the latest vision–language LMMs. Finally, we provide a summary of both LLMs and LMMs from a unified perspective, make an analysis of the development status of large-scale models in the view of globalization, and offer potential research directions for large-scale models.
Förderung
- National Natural Science Foundation of China
- Stable Support Projects for Shenzhen Higher Education Institutions
- Natural Science Foundation of Top Talent of SZTU
Zitieren
APA
Huang, D., Yan, C., Li, Q., & Peng, X. (2024). From Large Language Models to Large Multimodal Models: A Literature Review. Applied Sciences, 14(12), 5068. https://doi.org/10.3390/app14125068
Vancouver
Huang D, Yan C, Li Q, Peng X. From Large Language Models to Large Multimodal Models: A Literature Review. Applied Sciences. 2024;14(12):5068. doi:10.3390/app14125068
BibTeX
@article{Huang2024,
author = {Huang, Dawei and Yan, Chuan and Li, Qing and Peng, Xiaojiang},
title = {From Large Language Models to Large Multimodal Models: A Literature Review},
journal = {Applied Sciences},
year = {2024},
volume = {14},
number = {12},
pages = {5068},
doi = {10.3390/app14125068}
}
EUVIMED