EUVIMEDEUVIMED entdecken
Crossref

Vision-Language Models for Vision Tasks: A Survey

Jingyi Zhang, Jiaxing Huang, Sheng Jin, Shijian Lu

IEEE Transactions on Pattern Analysis and Machine Intelligence · 2024-08 · 46 (8) · 5625-5644

DOI: 10.1109/tpami.2024.3369699 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024-08. Verfasst von Jingyi Zhang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 1040-mal zitiert (Crossref) und nennt 202 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Most visual recognition studies rely heavily on crowd-labelled data in deep neural networks (DNNs) training, and they usually train a DNN for each single visual recognition task, leading to a laborious and time-consuming visual recognition paradigm. To address the two challenges, Vision-Language Models (VLMs) have been intensively investigated recently, which learns rich vision-language correlation from web-scale image-text pairs that are almost infinitely available on the Internet and enables zero-shot predictions on various visual recognition tasks with a single VLM. This paper provides a systematic review of visual language models for various visual recognition tasks, including: (1) the background that introduces the development of visual recognition paradigms; (2) the foundations of VLM that summarize the widely-adopted network architectures, pre-training objectives, and downstream tasks; (3) the widely-adopted datasets in VLM pre-training and evaluations; (4) the review and categorization of existing VLM pre-training methods, VLM transfer learning methods, and VLM knowledge distillation methods; (5) the benchmarking, analysis and discussion of the reviewed methods; (6) several research challenges and potential research directions that could be pursued in the future VLM studies for visual recognition.

Zitieren

APA

Zhang, J., Huang, J., Jin, S., & Lu, S. (2024). Vision-Language Models for Vision Tasks: A Survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 46(8), 5625-5644. https://doi.org/10.1109/tpami.2024.3369699

Vancouver

Zhang J, Huang J, Jin S, Lu S. Vision-Language Models for Vision Tasks: A Survey. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2024;46(8):5625-5644. doi:10.1109/tpami.2024.3369699

BibTeX
@article{Zhang2024,
  author = {Zhang, Jingyi and Huang, Jiaxing and Jin, Sheng and Lu, Shijian},
  title = {Vision-Language Models for Vision Tasks: A Survey},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year = {2024},
  volume = {46},
  number = {8},
  pages = {5625--5644},
  doi = {10.1109/tpami.2024.3369699}
}
Kostenlos starten →