EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Operationalizing Geographic Diversity for the Evaluation of AI ‐Generated Content

Zilong Liu, Krzysztof Janowicz, Ivan Majic, Meilin Shi, Alexandra Fortacz, Mina Karimi, Gengchen Mai, Kitty Currier

Transactions in GIS · 2025-05 · 29 (3)

DOI: 10.1111/tgis.70057 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Transactions in GIS, online erschienen am 13.05.2025. Verfasst von Zilong Liu und 7 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 95 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The introduction and widespread use of foundation models has accelerated the necessity of identifying geographic bias in AI‐generated content. In this respect, we operationalize geographic diversity as a countermeasure. We refine the notion of geographic diversity as the quality of including data from various places and maintaining a balance across these places in both learning and generation processes. Drawing from information theory, ecology, and prior work in AI evaluation, we provide an entropy‐based definition of geographic diversity and propose to measure geographic diversity as effective numbers of places. We apply our measurement by studying generated content from six large language models, including GPT‐3.5, GPT‐4o, Mistral 7B, Mistral Large, Claude 3 Haiku, and Claude 3.5 Sonnet. Our case study reveals that prompt variations, such as modifying concept mentions or scale mentions in a user prompt, can result in more geographic diversity in their generated content. In addition, we observe that less advanced models can generate more geographically diverse content than state‐of‐the‐art ones. Furthermore, certain places dominate the generated content of these models, yet their prominence does not reflect their real‐world counterparts. Our work stresses the importance of quantifying geographic information in AI‐generated content to support GeoAI and the broader AI evaluation in the age of foundation models.

Zitieren

APA

Liu, Z., Janowicz, K., Majic, I., Shi, M., Fortacz, A., Karimi, M., Mai, G., & Currier, K. (2025). Operationalizing Geographic Diversity for the Evaluation of AI ‐Generated Content. Transactions in GIS, 29(3). https://doi.org/10.1111/tgis.70057

Vancouver

Liu Z, Janowicz K, Majic I, Shi M, Fortacz A, Karimi M, et al. Operationalizing Geographic Diversity for the Evaluation of AI ‐Generated Content. Transactions in GIS. 2025;29(3). doi:10.1111/tgis.70057

BibTeX
@article{Liu2025,
  author = {Liu, Zilong and Janowicz, Krzysztof and Majic, Ivan and Shi, Meilin and Fortacz, Alexandra and Karimi, Mina and Mai, Gengchen and Currier, Kitty},
  title = {Operationalizing Geographic Diversity for the Evaluation of AI ‐Generated Content},
  journal = {Transactions in GIS},
  year = {2025},
  volume = {29},
  number = {3},
  doi = {10.1111/tgis.70057}
}
Kostenlos starten →