EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Scene-level buildings damage recognition based on Cross Conv-Transformer

Lingfei Shi, Feng Zhang, Junshi Xia, Jibo Xie

International Journal of Digital Earth · 08.12.2023 · 16 (2) · 3987-4007

DOI: 10.1080/17538947.2023.2261770 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Digital Earth, online erschienen am 28.09.2023. Verfasst von Lingfei Shi und 3 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 48 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Key Research and Development Program of China, KAKENHI.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Different to pixel-based and object-based image recognition, a larger perspective based on the scene can improve the efficiency of assessing large-scale building damage. However, the complexity of disaster scenes and the scarcity of datasets are major challenges in identifying building damage. To address these challenges, the Cross Conv-Transformer model is proposed to classify and evaluate the degree of damage to buildings using aerial images taken after earthquake. We employ Conv-Embedding and Conv-Projection to extract features from the images. The integration of convolution and Transformer reduces the computational burden of the model while enhancing its feature extraction capabilities. Furthermore, the two branch Conv-Transformer architecture with global and local attention is designed, allowing each branch to focus on global and local features respectively. The cross-attention fusion module merges feature information from the two branches to enrich classification features. At last, we utilize aerial images captured during the Beichuan and Yushu earthquakes as both the training and test sets to assess the model. The proposed Cross Conv-Transformer model improved classification accuracy by 4.7% and 2.1% compared to the ViT and EfficientNet. The results show that the Cross Conv-Transformer model could significantly reduces misclassification between severely and moderately damaged categories.

Förderung

  • National Key Research and Development Program of China
  • KAKENHI

Zitieren

APA

Shi, L., Zhang, F., Xia, J., & Xie, J. (2023). Scene-level buildings damage recognition based on Cross Conv-Transformer. International Journal of Digital Earth, 16(2), 3987-4007. https://doi.org/10.1080/17538947.2023.2261770

Vancouver

Shi L, Zhang F, Xia J, Xie J. Scene-level buildings damage recognition based on Cross Conv-Transformer. International Journal of Digital Earth. 2023;16(2):3987-4007. doi:10.1080/17538947.2023.2261770

BibTeX
@article{Shi2023,
  author = {Shi, Lingfei and Zhang, Feng and Xia, Junshi and Xie, Jibo},
  title = {Scene-level buildings damage recognition based on Cross Conv-Transformer},
  journal = {International Journal of Digital Earth},
  year = {2023},
  volume = {16},
  number = {2},
  pages = {3987--4007},
  doi = {10.1080/17538947.2023.2261770}
}
Kostenlos starten →