EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

PointMM: Point Cloud Semantic Segmentation CNN under Multi-Spatial Feature Encoding and Multi-Head Attention Pooling

Ruixing Chen, Jun Wu, Ying Luo, Gang Xu

Remote Sensing · 31.03.2024 · 16 (7) · 1246

DOI: 10.3390/rs16071246 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 31.03.2024. Verfasst von Ruixing Chen und 3 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 52 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Natural Science Foundation of China, Ningbo Science and Technology Innovation Project, Innovation Project of Guangxi Graduate Education.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

For the actual collected point cloud data, there are widespread challenges such as semantic inconsistency, density variations, and sparse spatial distribution. A network called PointMM is developed in this study to enhance the accuracy of point cloud semantic segmentation in complex scenes. The main contribution of PointMM involves two aspects: (1) Multi-spatial feature encoding. We leverage a novel feature encoding module to learn multi-spatial features from the neighborhood point set obtained by k-nearest neighbors (KNN) in the feature space. This enhances the network’s ability to learn the spatial structures of various samples more finely and completely. (2) Multi-head attention pooling. We leverage a multi-head attention pooling module to address the limitations of symmetric function-based pooling, such as maximum and average pooling, in terms of losing detailed feature information. This is achieved by aggregating multi-spatial and attribute features of point clouds, thereby enhancing the network’s ability to transmit information more comprehensively and accurately. Experiments on publicly available point cloud datasets S3DIS and ISPRS 3D Vaihingen demonstrate that PointMM effectively learns features at different levels, while improving the semantic segmentation accuracy of various objects. Compared to 12 state-of-the-art methods reported in the literature, PointMM outperforms the runner-up by 2.3% in OA on the ISPRS 3D Vaihingen dataset, and achieves the third best performance in both OA and MioU on the S3DIS dataset. Both achieve a satisfactory balance between OA, F1, and MioU.

Förderung

  • Natural Science Foundation of China
  • Ningbo Science and Technology Innovation Project
  • Innovation Project of Guangxi Graduate Education
  • National Key Research and Development Program of China

Zitieren

APA

Chen, R., Wu, J., Luo, Y., & Xu, G. (2024). PointMM: Point Cloud Semantic Segmentation CNN under Multi-Spatial Feature Encoding and Multi-Head Attention Pooling. Remote Sensing, 16(7), 1246. https://doi.org/10.3390/rs16071246

Vancouver

Chen R, Wu J, Luo Y, Xu G. PointMM: Point Cloud Semantic Segmentation CNN under Multi-Spatial Feature Encoding and Multi-Head Attention Pooling. Remote Sensing. 2024;16(7):1246. doi:10.3390/rs16071246

BibTeX
@article{Chen2024,
  author = {Chen, Ruixing and Wu, Jun and Luo, Ying and Xu, Gang},
  title = {PointMM: Point Cloud Semantic Segmentation CNN under Multi-Spatial Feature Encoding and Multi-Head Attention Pooling},
  journal = {Remote Sensing},
  year = {2024},
  volume = {16},
  number = {7},
  pages = {1246},
  doi = {10.3390/rs16071246}
}
Kostenlos starten →