PointMM: Point Cloud Semantic Segmentation CNN under Multi-Spatial Feature Encoding and Multi-Head Attention Pooling
Remote Sensing · 31.03.2024 · 16 (7) · 1246
DOI: 10.3390/rs16071246 ↗Kurz gefasst
Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 31.03.2024. Verfasst von Ruixing Chen und 3 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 52 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Natural Science Foundation of China, Ningbo Science and Technology Innovation Project, Innovation Project of Guangxi Graduate Education.
Abstract (Originalsprache)
For the actual collected point cloud data, there are widespread challenges such as semantic inconsistency, density variations, and sparse spatial distribution. A network called PointMM is developed in this study to enhance the accuracy of point cloud semantic segmentation in complex scenes. The main contribution of PointMM involves two aspects: (1) Multi-spatial feature encoding. We leverage a novel feature encoding module to learn multi-spatial features from the neighborhood point set obtained by k-nearest neighbors (KNN) in the feature space. This enhances the network’s ability to learn the spatial structures of various samples more finely and completely. (2) Multi-head attention pooling. We leverage a multi-head attention pooling module to address the limitations of symmetric function-based pooling, such as maximum and average pooling, in terms of losing detailed feature information. This is achieved by aggregating multi-spatial and attribute features of point clouds, thereby enhancing the network’s ability to transmit information more comprehensively and accurately. Experiments on publicly available point cloud datasets S3DIS and ISPRS 3D Vaihingen demonstrate that PointMM effectively learns features at different levels, while improving the semantic segmentation accuracy of various objects. Compared to 12 state-of-the-art methods reported in the literature, PointMM outperforms the runner-up by 2.3% in OA on the ISPRS 3D Vaihingen dataset, and achieves the third best performance in both OA and MioU on the S3DIS dataset. Both achieve a satisfactory balance between OA, F1, and MioU.
Förderung
- Natural Science Foundation of China
- Ningbo Science and Technology Innovation Project
- Innovation Project of Guangxi Graduate Education
- National Key Research and Development Program of China
Zitieren
APA
Chen, R., Wu, J., Luo, Y., & Xu, G. (2024). PointMM: Point Cloud Semantic Segmentation CNN under Multi-Spatial Feature Encoding and Multi-Head Attention Pooling. Remote Sensing, 16(7), 1246. https://doi.org/10.3390/rs16071246
Vancouver
Chen R, Wu J, Luo Y, Xu G. PointMM: Point Cloud Semantic Segmentation CNN under Multi-Spatial Feature Encoding and Multi-Head Attention Pooling. Remote Sensing. 2024;16(7):1246. doi:10.3390/rs16071246
BibTeX
@article{Chen2024,
author = {Chen, Ruixing and Wu, Jun and Luo, Ying and Xu, Gang},
title = {PointMM: Point Cloud Semantic Segmentation CNN under Multi-Spatial Feature Encoding and Multi-Head Attention Pooling},
journal = {Remote Sensing},
year = {2024},
volume = {16},
number = {7},
pages = {1246},
doi = {10.3390/rs16071246}
}
EUVIMED