EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Multi-class sewer defect detection with vision-language models

Riccardo Taormina, Job Augustijn van der Werf

Cambridge Prisms: Water · 2026 · 4

DOI: 10.1017/wat.2026.10019 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Cambridge Prisms: Water, online erschienen am 25.03.2026. Verfasst von Riccardo Taormina und 1 weiteren Autor:innen. Die Arbeit nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Proactive sewer asset management requires accurate condition assessment, yet CCTV inspections remain costly because interpretation is manual. We evaluated 18 vision-language models (VLMs) in a zero-shot setting for automated classification of six sewer defect types using a curated dataset. Each model produced a defect label, a short explanation, and a confidence score. OpenAI proprietary models outperformed open-source ones. GPT-4.1 mini achieved the highest macro-F1 score (0.50), outperforming much larger models, especially for surface damage and cracks/breaks. Some open-source models, such as LLaMa 4 (16x17B) and Qwen2.5-VL (32B), performed above random guessing but remained behind the proprietary models. All models failed to detect production errors, the most difficult class, and performed poorly on deformations. Confidence scores were generally unreliable, with little distinction between correct and incorrect predictions. Textual-output analysis showed that models sometimes described defects accurately even when the assigned label was wrong, although major hallucinations remained. We conclude that VLMs show some promise for sewer asset management, but they are not ready for deployment. Future work should focus on adding asset metadata to prompts and fine-tuning open-source models, especially since larger, newer, and more expensive OpenAI models did not outperform smaller ones, although confirmation requires a more thorough statistical analysis.

Zitieren

APA

Taormina, R., & Werf, J. A. V. D. (2026). Multi-class sewer defect detection with vision-language models. Cambridge Prisms: Water, 4. https://doi.org/10.1017/wat.2026.10019

Vancouver

Taormina R, Werf JAVD. Multi-class sewer defect detection with vision-language models. Cambridge Prisms: Water. 2026;4. doi:10.1017/wat.2026.10019

BibTeX
@article{Taormina2026,
  author = {Taormina, Riccardo and Werf, Job Augustijn van der},
  title = {Multi-class sewer defect detection with vision-language models},
  journal = {Cambridge Prisms: Water},
  year = {2026},
  volume = {4},
  doi = {10.1017/wat.2026.10019}
}
Kostenlos starten →