EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Hybrid Vision Transformer and Convolutional Network for Automated Road Damage Detection

Abu Kausar, Mohidul Islam, Abu Shahed Shah Md Nazmul Arefin, S. M. Ishtiaque Ahammed Khan Ishti, Md. Salah Uddin, Kazi Jahid Hasan

IET Image Processing · 2026-01 · 20 (1)

DOI: 10.1049/ipr2.70330 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IET Image Processing, online erschienen am 24.04.2026. Verfasst von Abu Kausar und 5 weiteren Autor:innen. Die Arbeit nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Efficient and accurate road damage detection is essential for transportation safety and infrastructure management. Traditional convolutional models often struggle with complex contextual patterns in real‐world scenarios. This paper introduces a novel hybrid architecture integrating convolutional neural networks (CNNs) for local texture extraction with vision transformers (ViTs) enhanced by shifted patch tokenization (SPT) and multi‐head self‐attention (MHSA) for global spatial reasoning. The framework effectively identifies surface irregularities such as cracks, potholes, and asphalt deformation. There are 1600 high‐resolution images in the original data set. Domain‐specific augmentation methods were used to overcome the problem of data scarcity, as well as to increase the generalization of the models by expanding the size of the training set to 6300 images throughout training. Validation and test sets had original unaugmented images so that there is unbiased evaluation. The ViT‐ResNet50 hybrid achieves state‐of‐the‐art classification accuracy of 99.1%, outperforming variants based on MobileNetV2, EfficientNet‐B0, and DenseNet121. explainable AI (XAI) techniques, including gradient‐weighted class activation mapping (Grad‐CAM) and LIME, provide visual insights into model decisions, enhancing transparency and trust. Ablation studies confirm that SPT and MHSA improve performance by an average of 10.4%. This approach represents a significant advancement toward interpretable, deployable systems for intelligent transportation and smart city ecosystems.

Zitieren

APA

Kausar, A., Islam, M., Arefin, A. S. S. M. N., Ishti, S. M. I. A. K., Uddin, M. S., & Hasan, K. J. (2026). Hybrid Vision Transformer and Convolutional Network for Automated Road Damage Detection. IET Image Processing, 20(1). https://doi.org/10.1049/ipr2.70330

Vancouver

Kausar A, Islam M, Arefin ASSMN, Ishti SMIAK, Uddin MS, Hasan KJ. Hybrid Vision Transformer and Convolutional Network for Automated Road Damage Detection. IET Image Processing. 2026;20(1). doi:10.1049/ipr2.70330

BibTeX
@article{Kausar2026,
  author = {Kausar, Abu and Islam, Mohidul and Arefin, Abu Shahed Shah Md Nazmul and Ishti, S. M. Ishtiaque Ahammed Khan and Uddin, Md. Salah and Hasan, Kazi Jahid},
  title = {Hybrid Vision Transformer and Convolutional Network for Automated Road Damage Detection},
  journal = {IET Image Processing},
  year = {2026},
  volume = {20},
  number = {1},
  doi = {10.1049/ipr2.70330}
}
Kostenlos starten →