Vision-Language Models in Remote Sensing: Current progress and future trends
IEEE Geoscience and Remote Sensing Magazine · 2024-06 · 12 (2) · 32-66
DOI: 10.1109/mgrs.2024.3383473 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Geoscience and Remote Sensing Magazine, 2024-06. Verfasst von Xiang Li und 4 weiteren Autor:innen. Die Arbeit wurde bisher 204-mal zitiert (Crossref) und nennt 271 Literaturangaben. Gefördert von: German Federal Ministry of Education and Research.
Abstract (Originalsprache)
The remarkable achievements of ChatGPT and Generative Pre-trained Transformer 4 (GPT-4) have sparked a wave of interest and research in the field of large language models (LLMs) for artificial general intelligence (AGI). These models provide intelligent solutions that are closer to human thinking, enabling us to use general artificial intelligence (AI) to solve problems in various applications. However, in the field of remote sensing (RS), the scientific literature on the implementation of AGI remains relatively scant. Existing AI-related research in RS focuses primarily on visual-understanding tasks while neglecting the semantic understanding of the objects and their relationships. This is where vision-LMs (VLMs) excel as they enable reasoning about images and their associated textual descriptions, allowing for a deeper understanding of the underlying semantics. VLMs can go beyond visual recognition of RS images and can model semantic relationships as well as generate natural language descriptions of the image. This makes them better suited for tasks that require both visual and textual understanding, such as image captioning and visual question answering (VQA). This article provides a comprehensive review of the research on VLMs in RS, summarizing the latest progress, highlighting current challenges, and identifying potential research opportunities. Specifically, we review the application of VLMs in mainstream RS tasks, including image captioning, text-based image generation, text-based image retrieval (TBIR), VQA, scene classification, semantic segmentation, and object detection. For each task, we analyze representative works and discuss research progress. Finally, we summarize the limitations of existing works and provide possible directions for future development. This review aims to provide a comprehensive overview of the current research progress of VLMs in RS (see Figure 1), and to inspire further research in this exciting and promising field.
Förderung
- German Federal Ministry of Education and Research
Zitieren
APA
Li, X., Wen, C., Hu, Y., Yuan, Z., & Zhu, X. X. (2024). Vision-Language Models in Remote Sensing: Current progress and future trends. IEEE Geoscience and Remote Sensing Magazine, 12(2), 32-66. https://doi.org/10.1109/mgrs.2024.3383473
Vancouver
Li X, Wen C, Hu Y, Yuan Z, Zhu XX. Vision-Language Models in Remote Sensing: Current progress and future trends. IEEE Geoscience and Remote Sensing Magazine. 2024;12(2):32-66. doi:10.1109/mgrs.2024.3383473
BibTeX
@article{Li2024,
author = {Li, Xiang and Wen, Congcong and Hu, Yuan and Yuan, Zhenghang and Zhu, Xiao Xiang},
title = {Vision-Language Models in Remote Sensing: Current progress and future trends},
journal = {IEEE Geoscience and Remote Sensing Magazine},
year = {2024},
volume = {12},
number = {2},
pages = {32--66},
doi = {10.1109/mgrs.2024.3383473}
}
EUVIMED