EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

LLM-Assisted Detection and Community-Based Review of Promotional Texts in OpenStreetMap: An Empirical Study

Pascal Neis

ISPRS International Journal of Geo-Information · 18.11.2026 · 15 (11) · 514

DOI: 10.3390/ijgi15110514 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ISPRS International Journal of Geo-Information, online erschienen am 18.11.2026. Verfasst von Pascal Neis. Die Arbeit nennt 52 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Promotional and SEO-oriented free-text content can undermine the neutrality and quality of OpenStreetMap (OSM). Because such text is multilingual and context-dependent, purely rule-based detection is challenging. This study evaluates large language models (LLMs) for identifying promotional content in OSM description=* tags and investigates their use in a community-based quality assurance workflow. A classification prompt was developed using a pilot dataset and evaluated on a balanced, manually annotated multilingual dataset of 1500 descriptions. Thirty-five open-weight model configurations were compared using precision, recall, F1-score, and runtime, and two conventional text-classification baselines were evaluated for classification performance. The best-performing model, llama3.3:70b, achieved 95.03% precision, 91.87% recall, and an F1-score of 93.42%, outperforming the evaluated conventional baselines. This model was then applied to 16,156 newly added or modified OSM descriptions in a real-world workflow. It identified 2738 descriptions as potentially promotional, resulting in 2599 public changeset comments. Within a 28-day follow-up period, 79.5% of analyzed commented cases were modified or removed, compared with 27.3% during a later comparison period without workflow-generated comments. Because the two conditions were temporally separated and non-randomized, this difference should be interpreted as an observational association.

Zitieren

APA

Neis, P. (2026). LLM-Assisted Detection and Community-Based Review of Promotional Texts in OpenStreetMap: An Empirical Study. ISPRS International Journal of Geo-Information, 15(11), 514. https://doi.org/10.3390/ijgi15110514

Vancouver

Neis P. LLM-Assisted Detection and Community-Based Review of Promotional Texts in OpenStreetMap: An Empirical Study. ISPRS International Journal of Geo-Information. 2026;15(11):514. doi:10.3390/ijgi15110514

BibTeX
@article{Neis2026,
  author = {Neis, Pascal},
  title = {LLM-Assisted Detection and Community-Based Review of Promotional Texts in OpenStreetMap: An Empirical Study},
  journal = {ISPRS International Journal of Geo-Information},
  year = {2026},
  volume = {15},
  number = {11},
  pages = {514},
  doi = {10.3390/ijgi15110514}
}
Kostenlos starten →