Vision-Language Pre-Training: Basics, Recent Advances, and Future Trends
Foundations and Trends® in Computer Graphics and Vision · 05.12.2022 · 14 (3-4) · 163-352
DOI: 10.1561/0600000105 ↗Kurz gefasst
Fachartikel in der Zeitschrift Foundations and Trends® in Computer Graphics and Vision, online erschienen am 05.12.2022. Verfasst von Zhe Gan und 5 weiteren Autor:innen. Die Arbeit wurde bisher 147-mal zitiert (Crossref) und nennt 532 Literaturangaben.
Abstract (Originalsprache)
This monograph surveys vision-language pre-training (VLP) methods for multimodal intelligence that have been developed in the last few years. We group these approaches into three categories: (i) VLP for image-text tasks, such as image captioning, image-text retrieval, visual question answering, and visual grounding; (ii) VLP for core computer vision tasks, such as (open-set) image classification, object detection, and segmentation; and (iii) VLP for video-text tasks, such as video captioning, video-text retrieval, and video question answering. For each category, we present a comprehensive review of state-of-the-art methods, and discuss the progress that has been made and challenges still being faced, using specific systems and models as case studies. In addition, for each category, we discuss advanced topics being actively explored in the research community, such as big foundation models, unified modeling, in-context few-shot learning, knowledge, robustness, and computer vision in the wild, to name a few.
Zitieren
APA
Gan, Z., Li, L., Li, C., Wang, L., Liu, Z., & Gao, J. (2022). Vision-Language Pre-Training: Basics, Recent Advances, and Future Trends. Foundations and Trends® in Computer Graphics and Vision, 14(3-4), 163-352. https://doi.org/10.1561/0600000105
Vancouver
Gan Z, Li L, Li C, Wang L, Liu Z, Gao J. Vision-Language Pre-Training: Basics, Recent Advances, and Future Trends. Foundations and Trends® in Computer Graphics and Vision. 2022;14(3-4):163-352. doi:10.1561/0600000105
BibTeX
@article{Gan2022,
author = {Gan, Zhe and Li, Linjie and Li, Chunyuan and Wang, Lijuan and Liu, Zicheng and Gao, Jianfeng},
title = {Vision-Language Pre-Training: Basics, Recent Advances, and Future Trends},
journal = {Foundations and Trends® in Computer Graphics and Vision},
year = {2022},
volume = {14},
number = {3-4},
pages = {163--352},
doi = {10.1561/0600000105}
}
EUVIMED