EUVIMEDEUVIMED entdecken
Crossref

Vision-Language Models in Remote Sensing: Current progress and future trends

Xiang Li, Congcong Wen, Yuan Hu, Zhenghang Yuan, Xiao Xiang Zhu

IEEE Geoscience and Remote Sensing Magazine · 2024-06 · 12 (2) · 32-66

DOI: 10.1109/mgrs.2024.3383473 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Geoscience and Remote Sensing Magazine, 2024-06. Verfasst von Xiang Li und 4 weiteren Autor:innen. Die Arbeit wurde bisher 204-mal zitiert (Crossref) und nennt 271 Literaturangaben. Gefördert von: German Federal Ministry of Education and Research.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The remarkable achievements of ChatGPT and Generative Pre-trained Transformer 4 (GPT-4) have sparked a wave of interest and research in the field of large language models (LLMs) for artificial general intelligence (AGI). These models provide intelligent solutions that are closer to human thinking, enabling us to use general artificial intelligence (AI) to solve problems in various applications. However, in the field of remote sensing (RS), the scientific literature on the implementation of AGI remains relatively scant. Existing AI-related research in RS focuses primarily on visual-understanding tasks while neglecting the semantic understanding of the objects and their relationships. This is where vision-LMs (VLMs) excel as they enable reasoning about images and their associated textual descriptions, allowing for a deeper understanding of the underlying semantics. VLMs can go beyond visual recognition of RS images and can model semantic relationships as well as generate natural language descriptions of the image. This makes them better suited for tasks that require both visual and textual understanding, such as image captioning and visual question answering (VQA). This article provides a comprehensive review of the research on VLMs in RS, summarizing the latest progress, highlighting current challenges, and identifying potential research opportunities. Specifically, we review the application of VLMs in mainstream RS tasks, including image captioning, text-based image generation, text-based image retrieval (TBIR), VQA, scene classification, semantic segmentation, and object detection. For each task, we analyze representative works and discuss research progress. Finally, we summarize the limitations of existing works and provide possible directions for future development. This review aims to provide a comprehensive overview of the current research progress of VLMs in RS (see Figure 1), and to inspire further research in this exciting and promising field.

Förderung

  • German Federal Ministry of Education and Research

Zitieren

APA

Li, X., Wen, C., Hu, Y., Yuan, Z., & Zhu, X. X. (2024). Vision-Language Models in Remote Sensing: Current progress and future trends. IEEE Geoscience and Remote Sensing Magazine, 12(2), 32-66. https://doi.org/10.1109/mgrs.2024.3383473

Vancouver

Li X, Wen C, Hu Y, Yuan Z, Zhu XX. Vision-Language Models in Remote Sensing: Current progress and future trends. IEEE Geoscience and Remote Sensing Magazine. 2024;12(2):32-66. doi:10.1109/mgrs.2024.3383473

BibTeX
@article{Li2024,
  author = {Li, Xiang and Wen, Congcong and Hu, Yuan and Yuan, Zhenghang and Zhu, Xiao Xiang},
  title = {Vision-Language Models in Remote Sensing: Current progress and future trends},
  journal = {IEEE Geoscience and Remote Sensing Magazine},
  year = {2024},
  volume = {12},
  number = {2},
  pages = {32--66},
  doi = {10.1109/mgrs.2024.3383473}
}
Kostenlos starten →