AerialFormer: Multi-Resolution Transformer for Aerial Image Segmentation
Remote Sensing · 09.08.2024 · 16 (16) · 2930
DOI: 10.3390/rs16162930 ↗Kurz gefasst
Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 09.08.2024. Verfasst von Taisei Hanyu und 8 weiteren Autor:innen. Die Arbeit wurde bisher 86-mal zitiert (Crossref) und nennt 117 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Science Foundation.
Abstract (Originalsprache)
When performing remote sensing image segmentation, practitioners often encounter various challenges, such as a strong imbalance in the foreground–background, the presence of tiny objects, high object density, intra-class heterogeneity, and inter-class homogeneity. To overcome these challenges, this paper introduces AerialFormer, a hybrid model that strategically combines the strengths of Transformers and Convolutional Neural Networks (CNNs). AerialFormer features a CNN Stem module integrated to preserve low-level and high-resolution features, enhancing the model’s capability to process details of aerial imagery. The proposed AerialFormer is designed with a hierarchical structure, in which a Transformer encoder generates multi-scale features and a multi-dilated CNN (MDC) decoder aggregates the information from the multi-scale inputs. As a result, information is taken into account in both local and global contexts, so that powerful representations and high-resolution segmentation can be achieved. The proposed AerialFormer was benchmarked on three benchmark datasets, including iSAID, LoveDA, and Potsdam. Comprehensive experiments and extensive ablation studies show that the proposed AerialFormer remarkably outperforms state-of-the-art methods.
Förderung
- National Science Foundation
Zitieren
APA
Hanyu, T., Yamazaki, K., Tran, M., McCann, R. A., Liao, H., Rainwater, C., Adkins, M., Cothren, J., & Le, N. (2024). AerialFormer: Multi-Resolution Transformer for Aerial Image Segmentation. Remote Sensing, 16(16), 2930. https://doi.org/10.3390/rs16162930
Vancouver
Hanyu T, Yamazaki K, Tran M, McCann RA, Liao H, Rainwater C, et al. AerialFormer: Multi-Resolution Transformer for Aerial Image Segmentation. Remote Sensing. 2024;16(16):2930. doi:10.3390/rs16162930
BibTeX
@article{Hanyu2024,
author = {Hanyu, Taisei and Yamazaki, Kashu and Tran, Minh and McCann, Roy A. and Liao, Haitao and Rainwater, Chase and Adkins, Meredith and Cothren, Jackson and Le, Ngan},
title = {AerialFormer: Multi-Resolution Transformer for Aerial Image Segmentation},
journal = {Remote Sensing},
year = {2024},
volume = {16},
number = {16},
pages = {2930},
doi = {10.3390/rs16162930}
}
EUVIMED