Attention-Guided Fusion and Classification for Hyperspectral and LiDAR Data
Remote Sensing · 25.12.2023 · 16 (1) · 94
DOI: 10.3390/rs16010094 ↗Kurz gefasst
Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 25.12.2023. Verfasst von Jing Huang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 22-mal zitiert (Crossref) und nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
The joint use of hyperspectral image (HSI) and Light Detection And Ranging (LiDAR) data has been widely applied for land cover classification because it can comprehensively represent the urban structures and land material properties. However, existing methods fail to combine the different image information effectively, which limits the semantic relevance of different data sources. To solve this problem, in this paper, an Attention-guided Fusion and Classification framework based on Convolutional Neural Network (AFC-CNN) is proposed to classify the land cover based on the joint use of HSI and LiDAR data. In the feature extraction module, AFC-CNN employs the three dimensional convolutional neural network (3D-CNN) combined with a multi-scale structure to extract the spatial-spectral features of HSI, and uses a 2D-CNN to extract the spatial features from LiDAR data. Simultaneously, the spectral attention mechanism is adopted to assign weights to the spectral channels, and the cross attention mechanism is introduced to impart significant spatial weights from LiDAR to HSI, which enhance the interaction between HSI and LiDAR data and leverage the fusion information. Then two feature branches are concatenated and transferred to the feature fusion module for higher-level feature extraction and fusion. In the fusion module, AFC-CNN adopts the depth separable convolution connected through the residual structures to obtain the advanced features, which can help reduce computational complexity and improve the fitting ability of the model. Finally, the fused features are sent into the linear classification module for final classification. Experimental results on three datasets, i.e., Houston, MUUFL and Trento datasets show that the proposed AFC-CNN framework achieves better classification accuracy compared with the state-of-the-art algorithms. The overall accuracy of AFC-CNN on Houston, MUUFL and Trento datasets are 94.2%, 95.3% and 99.5%, respectively.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Huang, J., Zhang, Y., Yang, F., & Chai, L. (2023). Attention-Guided Fusion and Classification for Hyperspectral and LiDAR Data. Remote Sensing, 16(1), 94. https://doi.org/10.3390/rs16010094
Vancouver
Huang J, Zhang Y, Yang F, Chai L. Attention-Guided Fusion and Classification for Hyperspectral and LiDAR Data. Remote Sensing. 2023;16(1):94. doi:10.3390/rs16010094
BibTeX
@article{Huang2023,
author = {Huang, Jing and Zhang, Yinghao and Yang, Fang and Chai, Li},
title = {Attention-Guided Fusion and Classification for Hyperspectral and LiDAR Data},
journal = {Remote Sensing},
year = {2023},
volume = {16},
number = {1},
pages = {94},
doi = {10.3390/rs16010094}
}
EUVIMED