EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Improving Mineral Classification Using Multimodal Hyperspectral Point Cloud Data and Multi-Stream Neural Network

Aldino Rizaldy, Ahmed Jamal Afifi, Pedram Ghamisi, Richard Gloaguen

Remote Sensing · 26.06.2024 · 16 (13) · 2336

DOI: 10.3390/rs16132336 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 26.06.2024. Verfasst von Aldino Rizaldy und 3 weiteren Autor:innen. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 82 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: European Regional Development Fund, the Land of Saxony.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In this paper, we leverage multimodal data to classify minerals using a multi-stream neural network. In a previous study on the Tinto dataset, which consisted of a 3D hyperspectral point cloud from the open-pit mine Corta Atalaya in Spain, we successfully identified mineral classes by employing various deep learning models. However, this prior work solely relied on hyperspectral data as input for the deep learning models. In this study, we aim to enhance accuracy by incorporating multimodal data, which includes hyperspectral images, RGB images, and a 3D point cloud. To achieve this, we have adopted a graph-based neural network, known for its efficiency in aggregating local information, based on our past observations where it consistently performed well across different hyperspectral sensors. Subsequently, we constructed a multi-stream neural network tailored to handle multimodality. Additionally, we employed a channel attention module on the hyperspectral stream to fully exploit the spectral information within the hyperspectral data. Through the integration of multimodal data and a multi-stream neural network, we achieved a notable improvement in mineral classification accuracy: 19.2%, 4.4%, and 5.6% on the LWIR, SWIR, and VNIR datasets, respectively.

Förderung

  • European Regional Development Fund
  • the Land of Saxony

Zitieren

APA

Rizaldy, A., Afifi, A. J., Ghamisi, P., & Gloaguen, R. (2024). Improving Mineral Classification Using Multimodal Hyperspectral Point Cloud Data and Multi-Stream Neural Network. Remote Sensing, 16(13), 2336. https://doi.org/10.3390/rs16132336

Vancouver

Rizaldy A, Afifi AJ, Ghamisi P, Gloaguen R. Improving Mineral Classification Using Multimodal Hyperspectral Point Cloud Data and Multi-Stream Neural Network. Remote Sensing. 2024;16(13):2336. doi:10.3390/rs16132336

BibTeX
@article{Rizaldy2024,
  author = {Rizaldy, Aldino and Afifi, Ahmed Jamal and Ghamisi, Pedram and Gloaguen, Richard},
  title = {Improving Mineral Classification Using Multimodal Hyperspectral Point Cloud Data and Multi-Stream Neural Network},
  journal = {Remote Sensing},
  year = {2024},
  volume = {16},
  number = {13},
  pages = {2336},
  doi = {10.3390/rs16132336}
}
Kostenlos starten →