EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

DDFAV: Remote Sensing Large Vision Language Models Dataset and Evaluation Benchmark

Haodong Li, Xiaofeng Zhang, Haicheng Qu

Remote Sensing · 19.02.2025 · 17 (4) · 719

DOI: 10.3390/rs17040719 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 19.02.2025. Verfasst von Haodong Li und 2 weiteren Autor:innen. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 81 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Scientiffc Research Foundation of the Higher Education Institutions of Liaoning Province.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

With the rapid development of large visual language models (LVLMs) and multimodal large language models (MLLMs), these models have demonstrated strong performance in various multimodal tasks. However, alleviating the generation of hallucinations remains a key challenge in LVLMs research. For remote sensing LVLMs, there are problems such as low quality, small number and unreliable datasets and evaluation methods. Therefore, when applied to remote sensing tasks, they are prone to hallucinations, resulting in unsatisfactory performance. This paper proposes a more reliable and effective instruction set production process for remote sensing LVLMs to address these issues. The process generates detailed and accurate instruction sets through strategies such as shallow-to-deep reasoning, internal and external considerations, and manual quality inspection. Based on this production process, we collect 1.6 GB of remote sensing images to create the DDFAV dataset, which covers a variety of remote sensing LVLMs tasks. Finally, we develop a closed binary classification polling evaluation method, RSPOPE, specifically designed to evaluate hallucinations in remote sensing LVLMs or MLLMs visual question-answering tasks. Using this method, we evaluate the zero-shot remote sensing visual question-answering capabilities of multiple mainstream LVLMs. Our proposed dataset images, corresponding instruction sets, and evaluation method files are all open source.

Förderung

  • National Natural Science Foundation of China
  • Scientiffc Research Foundation of the Higher Education Institutions of Liaoning Province

Zitieren

APA

Li, H., Zhang, X., & Qu, H. (2025). DDFAV: Remote Sensing Large Vision Language Models Dataset and Evaluation Benchmark. Remote Sensing, 17(4), 719. https://doi.org/10.3390/rs17040719

Vancouver

Li H, Zhang X, Qu H. DDFAV: Remote Sensing Large Vision Language Models Dataset and Evaluation Benchmark. Remote Sensing. 2025;17(4):719. doi:10.3390/rs17040719

BibTeX
@article{Li2025,
  author = {Li, Haodong and Zhang, Xiaofeng and Qu, Haicheng},
  title = {DDFAV: Remote Sensing Large Vision Language Models Dataset and Evaluation Benchmark},
  journal = {Remote Sensing},
  year = {2025},
  volume = {17},
  number = {4},
  pages = {719},
  doi = {10.3390/rs17040719}
}
Kostenlos starten →