DDFAV: Remote Sensing Large Vision Language Models Dataset and Evaluation Benchmark
Remote Sensing · 19.02.2025 · 17 (4) · 719
DOI: 10.3390/rs17040719 ↗Kurz gefasst
Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 19.02.2025. Verfasst von Haodong Li und 2 weiteren Autor:innen. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 81 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Scientiffc Research Foundation of the Higher Education Institutions of Liaoning Province.
Abstract (Originalsprache)
With the rapid development of large visual language models (LVLMs) and multimodal large language models (MLLMs), these models have demonstrated strong performance in various multimodal tasks. However, alleviating the generation of hallucinations remains a key challenge in LVLMs research. For remote sensing LVLMs, there are problems such as low quality, small number and unreliable datasets and evaluation methods. Therefore, when applied to remote sensing tasks, they are prone to hallucinations, resulting in unsatisfactory performance. This paper proposes a more reliable and effective instruction set production process for remote sensing LVLMs to address these issues. The process generates detailed and accurate instruction sets through strategies such as shallow-to-deep reasoning, internal and external considerations, and manual quality inspection. Based on this production process, we collect 1.6 GB of remote sensing images to create the DDFAV dataset, which covers a variety of remote sensing LVLMs tasks. Finally, we develop a closed binary classification polling evaluation method, RSPOPE, specifically designed to evaluate hallucinations in remote sensing LVLMs or MLLMs visual question-answering tasks. Using this method, we evaluate the zero-shot remote sensing visual question-answering capabilities of multiple mainstream LVLMs. Our proposed dataset images, corresponding instruction sets, and evaluation method files are all open source.
Förderung
- National Natural Science Foundation of China
- Scientiffc Research Foundation of the Higher Education Institutions of Liaoning Province
Zitieren
APA
Li, H., Zhang, X., & Qu, H. (2025). DDFAV: Remote Sensing Large Vision Language Models Dataset and Evaluation Benchmark. Remote Sensing, 17(4), 719. https://doi.org/10.3390/rs17040719
Vancouver
Li H, Zhang X, Qu H. DDFAV: Remote Sensing Large Vision Language Models Dataset and Evaluation Benchmark. Remote Sensing. 2025;17(4):719. doi:10.3390/rs17040719
BibTeX
@article{Li2025,
author = {Li, Haodong and Zhang, Xiaofeng and Qu, Haicheng},
title = {DDFAV: Remote Sensing Large Vision Language Models Dataset and Evaluation Benchmark},
journal = {Remote Sensing},
year = {2025},
volume = {17},
number = {4},
pages = {719},
doi = {10.3390/rs17040719}
}
EUVIMED