EUVIMEDSkopri EUVIMED
Open access · CC BY 4.0

Hybrid Vision Transformer and Convolutional Network for Automated Road Damage Detection

Abu Kausar, Mohidul Islam, Abu Shahed Shah Md Nazmul Arefin, S. M. Ishtiaque Ahammed Khan Ishti, Md. Salah Uddin, Kazi Jahid Hasan

IET Image Processing · 2026-01 · 20 (1)

DOI: 10.1049/ipr2.70330 ↗

At a glance

Journal article in IET Image Processing, published online on 2026-04-24. Written by Abu Kausar and 5 co-authors. 26 references. The full text is freely available (open access, CC BY 4.0).

AstrattDettalji biblijografiċiCiteRelated studies

Abstract (original language)

Efficient and accurate road damage detection is essential for transportation safety and infrastructure management. Traditional convolutional models often struggle with complex contextual patterns in real‐world scenarios. This paper introduces a novel hybrid architecture integrating convolutional neural networks (CNNs) for local texture extraction with vision transformers (ViTs) enhanced by shifted patch tokenization (SPT) and multi‐head self‐attention (MHSA) for global spatial reasoning. The framework effectively identifies surface irregularities such as cracks, potholes, and asphalt deformation. There are 1600 high‐resolution images in the original data set. Domain‐specific augmentation methods were used to overcome the problem of data scarcity, as well as to increase the generalization of the models by expanding the size of the training set to 6300 images throughout training. Validation and test sets had original unaugmented images so that there is unbiased evaluation. The ViT‐ResNet50 hybrid achieves state‐of‐the‐art classification accuracy of 99.1%, outperforming variants based on MobileNetV2, EfficientNet‐B0, and DenseNet121. explainable AI (XAI) techniques, including gradient‐weighted class activation mapping (Grad‐CAM) and LIME, provide visual insights into model decisions, enhancing transparency and trust. Ablation studies confirm that SPT and MHSA improve performance by an average of 10.4%. This approach represents a significant advancement toward interpretable, deployable systems for intelligent transportation and smart city ecosystems.

Cite

APA

Kausar, A., Islam, M., Arefin, A. S. S. M. N., Ishti, S. M. I. A. K., Uddin, M. S., & Hasan, K. J. (2026). Hybrid Vision Transformer and Convolutional Network for Automated Road Damage Detection. IET Image Processing, 20(1). https://doi.org/10.1049/ipr2.70330

Vancouver

Kausar A, Islam M, Arefin ASSMN, Ishti SMIAK, Uddin MS, Hasan KJ. Hybrid Vision Transformer and Convolutional Network for Automated Road Damage Detection. IET Image Processing. 2026;20(1). doi:10.1049/ipr2.70330

BibTeX
@article{Kausar2026,
  author = {Kausar, Abu and Islam, Mohidul and Arefin, Abu Shahed Shah Md Nazmul and Ishti, S. M. Ishtiaque Ahammed Khan and Uddin, Md. Salah and Hasan, Kazi Jahid},
  title = {Hybrid Vision Transformer and Convolutional Network for Automated Road Damage Detection},
  journal = {IET Image Processing},
  year = {2026},
  volume = {20},
  number = {1},
  doi = {10.1049/ipr2.70330}
}
Start for free →