Improving Mineral Classification Using Multimodal Hyperspectral Point Cloud Data and Multi-Stream Neural Network
Remote Sensing · 26.06.2024 · 16 (13) · 2336
DOI: 10.3390/rs16132336 ↗Kurz gefasst
Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 26.06.2024. Verfasst von Aldino Rizaldy und 3 weiteren Autor:innen. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 82 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: European Regional Development Fund, the Land of Saxony.
Abstract (Originalsprache)
In this paper, we leverage multimodal data to classify minerals using a multi-stream neural network. In a previous study on the Tinto dataset, which consisted of a 3D hyperspectral point cloud from the open-pit mine Corta Atalaya in Spain, we successfully identified mineral classes by employing various deep learning models. However, this prior work solely relied on hyperspectral data as input for the deep learning models. In this study, we aim to enhance accuracy by incorporating multimodal data, which includes hyperspectral images, RGB images, and a 3D point cloud. To achieve this, we have adopted a graph-based neural network, known for its efficiency in aggregating local information, based on our past observations where it consistently performed well across different hyperspectral sensors. Subsequently, we constructed a multi-stream neural network tailored to handle multimodality. Additionally, we employed a channel attention module on the hyperspectral stream to fully exploit the spectral information within the hyperspectral data. Through the integration of multimodal data and a multi-stream neural network, we achieved a notable improvement in mineral classification accuracy: 19.2%, 4.4%, and 5.6% on the LWIR, SWIR, and VNIR datasets, respectively.
Förderung
- European Regional Development Fund
- the Land of Saxony
Zitieren
APA
Rizaldy, A., Afifi, A. J., Ghamisi, P., & Gloaguen, R. (2024). Improving Mineral Classification Using Multimodal Hyperspectral Point Cloud Data and Multi-Stream Neural Network. Remote Sensing, 16(13), 2336. https://doi.org/10.3390/rs16132336
Vancouver
Rizaldy A, Afifi AJ, Ghamisi P, Gloaguen R. Improving Mineral Classification Using Multimodal Hyperspectral Point Cloud Data and Multi-Stream Neural Network. Remote Sensing. 2024;16(13):2336. doi:10.3390/rs16132336
BibTeX
@article{Rizaldy2024,
author = {Rizaldy, Aldino and Afifi, Ahmed Jamal and Ghamisi, Pedram and Gloaguen, Richard},
title = {Improving Mineral Classification Using Multimodal Hyperspectral Point Cloud Data and Multi-Stream Neural Network},
journal = {Remote Sensing},
year = {2024},
volume = {16},
number = {13},
pages = {2336},
doi = {10.3390/rs16132336}
}
EUVIMED