LLM-Assisted Detection and Community-Based Review of Promotional Texts in OpenStreetMap: An Empirical Study
ISPRS International Journal of Geo-Information · 18.11.2026 · 15 (11) · 514
DOI: 10.3390/ijgi15110514 ↗Kurz gefasst
Fachartikel in der Zeitschrift ISPRS International Journal of Geo-Information, online erschienen am 18.11.2026. Verfasst von Pascal Neis. Die Arbeit nennt 52 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Promotional and SEO-oriented free-text content can undermine the neutrality and quality of OpenStreetMap (OSM). Because such text is multilingual and context-dependent, purely rule-based detection is challenging. This study evaluates large language models (LLMs) for identifying promotional content in OSM description=* tags and investigates their use in a community-based quality assurance workflow. A classification prompt was developed using a pilot dataset and evaluated on a balanced, manually annotated multilingual dataset of 1500 descriptions. Thirty-five open-weight model configurations were compared using precision, recall, F1-score, and runtime, and two conventional text-classification baselines were evaluated for classification performance. The best-performing model, llama3.3:70b, achieved 95.03% precision, 91.87% recall, and an F1-score of 93.42%, outperforming the evaluated conventional baselines. This model was then applied to 16,156 newly added or modified OSM descriptions in a real-world workflow. It identified 2738 descriptions as potentially promotional, resulting in 2599 public changeset comments. Within a 28-day follow-up period, 79.5% of analyzed commented cases were modified or removed, compared with 27.3% during a later comparison period without workflow-generated comments. Because the two conditions were temporally separated and non-randomized, this difference should be interpreted as an observational association.
Zitieren
APA
Neis, P. (2026). LLM-Assisted Detection and Community-Based Review of Promotional Texts in OpenStreetMap: An Empirical Study. ISPRS International Journal of Geo-Information, 15(11), 514. https://doi.org/10.3390/ijgi15110514
Vancouver
Neis P. LLM-Assisted Detection and Community-Based Review of Promotional Texts in OpenStreetMap: An Empirical Study. ISPRS International Journal of Geo-Information. 2026;15(11):514. doi:10.3390/ijgi15110514
BibTeX
@article{Neis2026,
author = {Neis, Pascal},
title = {LLM-Assisted Detection and Community-Based Review of Promotional Texts in OpenStreetMap: An Empirical Study},
journal = {ISPRS International Journal of Geo-Information},
year = {2026},
volume = {15},
number = {11},
pages = {514},
doi = {10.3390/ijgi15110514}
}
EUVIMED