SADAMB: Advancing Spatially-Aware Vision-Language Modeling Through Datasets, Metrics, and Benchmarks
Computers · 29.09.2025 · 14 (10) · 413
DOI: 10.3390/computers14100413 ↗Kurz gefasst
Fachartikel in der Zeitschrift Computers, online erschienen am 29.09.2025. Verfasst von Giorgos Papadopoulos und 4 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: EU Project VOXReality.
Abstract (Originalsprache)
Understanding spatial relationships between objects in images is crucial for robotic navigation, augmented reality systems, and autonomous driving applications, among others. However, existing vision-language benchmarks often overlook explicit spatial reasoning, limiting progress in this area. We attribute this limitation in part to existing open datasets and evaluation metrics, which tend to overlook spatial details. To address this gap, we make three contributions: First, we greatly extend the COCO dataset with annotations of spatial relations, providing a resource for spatially aware image captioning and visual question answering. Second, we propose a new evaluation framework encompassing metrics that assess image captions’ spatial accuracy at both the sentence and dataset levels. And third, we conduct a benchmark study of various vision encoder–text decoder transformer architectures for image captioning using the introduced dataset and metrics. Results reveal that current models capture spatial information only partially, underscoring the challenges of spatially grounded caption generation.
Förderung
- EU Project VOXReality
Zitieren
APA
Papadopoulos, G., Drakoulis, P., Ntovas, A., Doumanoglou, A., & Zarpalas, D. (2025). SADAMB: Advancing Spatially-Aware Vision-Language Modeling Through Datasets, Metrics, and Benchmarks. Computers, 14(10), 413. https://doi.org/10.3390/computers14100413
Vancouver
Papadopoulos G, Drakoulis P, Ntovas A, Doumanoglou A, Zarpalas D. SADAMB: Advancing Spatially-Aware Vision-Language Modeling Through Datasets, Metrics, and Benchmarks. Computers. 2025;14(10):413. doi:10.3390/computers14100413
BibTeX
@article{Papadopoulos2025,
author = {Papadopoulos, Giorgos and Drakoulis, Petros and Ntovas, Athanasios and Doumanoglou, Alexandros and Zarpalas, Dimitris},
title = {SADAMB: Advancing Spatially-Aware Vision-Language Modeling Through Datasets, Metrics, and Benchmarks},
journal = {Computers},
year = {2025},
volume = {14},
number = {10},
pages = {413},
doi = {10.3390/computers14100413}
}
EUVIMED