EUVIMEDEUVIMED entdecken
Crossref

Superpoint Transformer for 3D Scene Instance Segmentation

Jiahao Sun, Chunmei Qing, Junpeng Tan, Xiangmin Xu

Proceedings of the AAAI Conference on Artificial Intelligence · 26.06.2023 · 37 (2) · 2393-2401

DOI: 10.1609/aaai.v37i2.25335 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 26.06.2023. Verfasst von Jiahao Sun und 3 weiteren Autor:innen. Die Arbeit wurde bisher 126-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Most existing methods realize 3D instance segmentation by extending those models used for 3D object detection or 3D semantic segmentation. However, these non-straightforward methods suffer from two drawbacks: 1) Imprecise bounding boxes or unsatisfactory semantic predictions limit the performance of the overall 3D instance segmentation framework. 2) Existing method requires a time-consuming intermediate step of aggregation. To address these issues, this paper proposes a novel end-to-end 3D instance segmentation method based on Superpoint Transformer, named as SPFormer. It groups potential features from point clouds into superpoints, and directly predicts instances through query vectors without relying on the results of object detection or semantic segmentation. The key step in this framework is a novel query decoder with transformers that can capture the instance information through the superpoint cross-attention mechanism and generate the superpoint masks of the instances. Through bipartite matching based on superpoint masks, SPFormer can implement the network training without the intermediate aggregation step, which accelerates the network. Extensive experiments on ScanNetv2 and S3DIS benchmarks verify that our method is concise yet efficient. Notably, SPFormer exceeds compared state-of-the-art methods by 4.3% on ScanNetv2 hidden test set in terms of mAP and keeps fast inference speed (247ms per frame) simultaneously. Code is available at https://github.com/sunjiahao1999/SPFormer.

Zitieren

APA

Sun, J., Qing, C., Tan, J., & Xu, X. (2023). Superpoint Transformer for 3D Scene Instance Segmentation. Proceedings of the AAAI Conference on Artificial Intelligence, 37(2), 2393-2401. https://doi.org/10.1609/aaai.v37i2.25335

Vancouver

Sun J, Qing C, Tan J, Xu X. Superpoint Transformer for 3D Scene Instance Segmentation. Proceedings of the AAAI Conference on Artificial Intelligence. 2023;37(2):2393-2401. doi:10.1609/aaai.v37i2.25335

BibTeX
@article{Sun2023,
  author = {Sun, Jiahao and Qing, Chunmei and Tan, Junpeng and Xu, Xiangmin},
  title = {Superpoint Transformer for 3D Scene Instance Segmentation},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2023},
  volume = {37},
  number = {2},
  pages = {2393--2401},
  doi = {10.1609/aaai.v37i2.25335}
}
Kostenlos starten →