Assessing the Geolocation Capabilities, Limitations and Societal Risks of Generative Vision-Language Models
Proceedings of the AAAI Symposium Series · 23.11.2025 · 7 (1) · 161-168
DOI: 10.1609/aaaiss.v7i1.36882 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Symposium Series, online erschienen am 23.11.2025. Verfasst von Oliver Grainge und 4 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref).
Abstract (Originalsprache)
Geo-localization is the task of identifying the location of an image using visual cues alone. It has beneficial applications, such as improving disaster response, enhancing navigation, and geography education. Recently, Vision-Language Models (VLMs) are increasingly demonstrating capabilities as accurate image geo-locators. This brings significant privacy risks, including those related to stalking and surveillance, considering the widespread uses of AI models and sharing of photos on social media. The precision of these models is likely to improve in the future. Despite these risks, there is little work on systematically evaluating the geolocation precision of Generative VLMs, their limits and potential for unintended inferences. To bridge this gap, we conduct a comprehensive assessment of the geolocation capabilities of 25 state-of-the-art VLMs on four benchmark image datasets captured in diverse environments. Our results offer insight into the internal reasoning of VLMs and highlight their strengths, limitations, and potential societal risks. Our findings indicate that current VLMs perform poorly on generic street-level images yet achieve notably high accuracy (61%) on images resembling social media content, raising significant and urgent privacy concerns.
Zitieren
APA
Grainge, O., Waheed, S., Stilgoe, J., Milford, M., & Ehsan, S. (2025). Assessing the Geolocation Capabilities, Limitations and Societal Risks of Generative Vision-Language Models. Proceedings of the AAAI Symposium Series, 7(1), 161-168. https://doi.org/10.1609/aaaiss.v7i1.36882
Vancouver
Grainge O, Waheed S, Stilgoe J, Milford M, Ehsan S. Assessing the Geolocation Capabilities, Limitations and Societal Risks of Generative Vision-Language Models. Proceedings of the AAAI Symposium Series. 2025;7(1):161-168. doi:10.1609/aaaiss.v7i1.36882
BibTeX
@article{Grainge2025,
author = {Grainge, Oliver and Waheed, Sania and Stilgoe, Jack and Milford, Michael and Ehsan, Shoaib},
title = {Assessing the Geolocation Capabilities, Limitations and Societal Risks of Generative Vision-Language Models},
journal = {Proceedings of the AAAI Symposium Series},
year = {2025},
volume = {7},
number = {1},
pages = {161--168},
doi = {10.1609/aaaiss.v7i1.36882}
}
EUVIMED