EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

From Large Language Models to Large Multimodal Models: A Literature Review

Dawei Huang, Chuan Yan, Qing Li, Xiaojiang Peng

Applied Sciences · 11.06.2024 · 14 (12) · 5068

DOI: 10.3390/app14125068 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 11.06.2024. Verfasst von Dawei Huang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 109-mal zitiert (Crossref) und nennt 182 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Stable Support Projects for Shenzhen Higher Education Institutions, Natural Science Foundation of Top Talent of SZTU.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

With the deepening of research on Large Language Models (LLMs), significant progress has been made in recent years on the development of Large Multimodal Models (LMMs), which are gradually moving toward Artificial General Intelligence. This paper aims to summarize the recent progress from LLMs to LMMs in a comprehensive and unified way. First, we start with LLMs and outline various conceptual frameworks and key techniques. Then, we focus on the architectural components, training strategies, fine-tuning guidance, and prompt engineering of LMMs, and present a taxonomy of the latest vision–language LMMs. Finally, we provide a summary of both LLMs and LMMs from a unified perspective, make an analysis of the development status of large-scale models in the view of globalization, and offer potential research directions for large-scale models.

Förderung

  • National Natural Science Foundation of China
  • Stable Support Projects for Shenzhen Higher Education Institutions
  • Natural Science Foundation of Top Talent of SZTU

Zitieren

APA

Huang, D., Yan, C., Li, Q., & Peng, X. (2024). From Large Language Models to Large Multimodal Models: A Literature Review. Applied Sciences, 14(12), 5068. https://doi.org/10.3390/app14125068

Vancouver

Huang D, Yan C, Li Q, Peng X. From Large Language Models to Large Multimodal Models: A Literature Review. Applied Sciences. 2024;14(12):5068. doi:10.3390/app14125068

BibTeX
@article{Huang2024,
  author = {Huang, Dawei and Yan, Chuan and Li, Qing and Peng, Xiaojiang},
  title = {From Large Language Models to Large Multimodal Models: A Literature Review},
  journal = {Applied Sciences},
  year = {2024},
  volume = {14},
  number = {12},
  pages = {5068},
  doi = {10.3390/app14125068}
}
Kostenlos starten →