EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Long-Tail Aware Cross-Modal Graph Attention Network for Fine-Grained Indoor 3D Semantic Segmentation of Point Clouds

Erdal Özbay iD, Feyza Altunbey Özbay iD

Sensors · 27.05.2026 · 26 (11) · 3401

DOI: 10.3390/s26113401 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 27.05.2026. Verfasst von Erdal Özbay und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer Engineering, Firat University, Elazig 23119, Türkiye. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 43 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Accurate and efficient semantic segmentation of point cloud data is critical in many application areas involving indoor scene understanding. In particular, fine-grained object categories, high data density, and class imbalance in high-resolution indoor datasets significantly limit class discrimination in 3D semantic segmentation. The multimodal data structure, high-fidelity geometry, and long-tail class distribution of the recently popular ScanNet++ dataset further exacerbate these challenges. This study proposes a novel Long-Tail Aware Cross-Modal Graph Attention Network (LT-CM-GACNet++) to address fine-grained 3D semantic segmentation under long-tail distributions. The proposed method integrates dynamic graph-based geometric feature extraction with a lightweight visual feature extractor based on MobileNetV3, enabling effective fusion of geometric and RGB-based information. The proposed Cross-Modal Graph Attention (CMGA) module facilitates adaptive information transfer between modalities, enabling more effective representation learning of both local and global contextual features. To mitigate the adverse effects of long-tail class distributions, prototype-based representation learning and a class frequency-aware loss function are jointly employed. This strategy improves the learning of rare classes while enhancing the discrimination between visually and geometrically similar categories. In the preprocessing stage, density-based sampling, normal vector estimation, and block-based fixed-size point cloud generation are applied to high-resolution mesh-derived data. The proposed model is evaluated on 50 scenes and 100 semantic classes selected from the ScanNet++ dataset. Experimental results demonstrate that the proposed method achieves significant improvements over existing approaches in terms of both overall segmentation performance and rare-class performance. In particular, notable gains are observed in mean Intersection over Union (mIoU) and rare-class mIoU metrics. These results highlight the effectiveness of cross-modal learning for high-resolution 3D scene segmentation under long-tail distributions.

Schlagwörter

Stichwörter der Autor:innen

cross-modal fusiongraph attention networkslong-tail learningpoint cloudsemantic segmentation

Autor:innen und Institutionen

  • Department of Computer Engineering, Firat University, Elazig 23119, Türkiye.
  • Department of Software Engineering, Firat University, Elazig 23119, Türkiye.

ORCID-Profile: Erdal Özbay, Feyza Altunbey Özbay

Zitieren

APA

Özbay, E., & Altunbey Özbay, F. (2026). Long-Tail Aware Cross-Modal Graph Attention Network for Fine-Grained Indoor 3D Semantic Segmentation of Point Clouds. Sensors, 26(11), 3401. https://doi.org/10.3390/s26113401

Vancouver

Özbay E, Altunbey Özbay F. Long-Tail Aware Cross-Modal Graph Attention Network for Fine-Grained Indoor 3D Semantic Segmentation of Point Clouds. Sensors. 2026;26(11):3401. doi:10.3390/s26113401

BibTeX
@article{zbay2026,
  author = {Özbay, Erdal and Altunbey Özbay, Feyza},
  title = {Long-Tail Aware Cross-Modal Graph Attention Network for Fine-Grained Indoor 3D Semantic Segmentation of Point Clouds},
  journal = {Sensors},
  year = {2026},
  volume = {26},
  number = {11},
  pages = {3401},
  doi = {10.3390/s26113401}
}
Kostenlos starten →