EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

AerialFormer: Multi-Resolution Transformer for Aerial Image Segmentation

Taisei Hanyu, Kashu Yamazaki, Minh Tran, Roy A. McCann, Haitao Liao, Chase Rainwater, Meredith Adkins, Jackson Cothren, Ngan Le

Remote Sensing · 09.08.2024 · 16 (16) · 2930

DOI: 10.3390/rs16162930 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 09.08.2024. Verfasst von Taisei Hanyu und 8 weiteren Autor:innen. Die Arbeit wurde bisher 86-mal zitiert (Crossref) und nennt 117 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Science Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

When performing remote sensing image segmentation, practitioners often encounter various challenges, such as a strong imbalance in the foreground–background, the presence of tiny objects, high object density, intra-class heterogeneity, and inter-class homogeneity. To overcome these challenges, this paper introduces AerialFormer, a hybrid model that strategically combines the strengths of Transformers and Convolutional Neural Networks (CNNs). AerialFormer features a CNN Stem module integrated to preserve low-level and high-resolution features, enhancing the model’s capability to process details of aerial imagery. The proposed AerialFormer is designed with a hierarchical structure, in which a Transformer encoder generates multi-scale features and a multi-dilated CNN (MDC) decoder aggregates the information from the multi-scale inputs. As a result, information is taken into account in both local and global contexts, so that powerful representations and high-resolution segmentation can be achieved. The proposed AerialFormer was benchmarked on three benchmark datasets, including iSAID, LoveDA, and Potsdam. Comprehensive experiments and extensive ablation studies show that the proposed AerialFormer remarkably outperforms state-of-the-art methods.

Förderung

  • National Science Foundation

Zitieren

APA

Hanyu, T., Yamazaki, K., Tran, M., McCann, R. A., Liao, H., Rainwater, C., Adkins, M., Cothren, J., & Le, N. (2024). AerialFormer: Multi-Resolution Transformer for Aerial Image Segmentation. Remote Sensing, 16(16), 2930. https://doi.org/10.3390/rs16162930

Vancouver

Hanyu T, Yamazaki K, Tran M, McCann RA, Liao H, Rainwater C, et al. AerialFormer: Multi-Resolution Transformer for Aerial Image Segmentation. Remote Sensing. 2024;16(16):2930. doi:10.3390/rs16162930

BibTeX
@article{Hanyu2024,
  author = {Hanyu, Taisei and Yamazaki, Kashu and Tran, Minh and McCann, Roy A. and Liao, Haitao and Rainwater, Chase and Adkins, Meredith and Cothren, Jackson and Le, Ngan},
  title = {AerialFormer: Multi-Resolution Transformer for Aerial Image Segmentation},
  journal = {Remote Sensing},
  year = {2024},
  volume = {16},
  number = {16},
  pages = {2930},
  doi = {10.3390/rs16162930}
}
Kostenlos starten →