EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Structure-Aware Multi-Modal Learning Framework for Robust Indoor Point-Cloud Registration

Changliang Zhang, Qingshan Xu, Xiongwei Sun, Gongqin Zhu

Electronics · 11.07.2026 · 15 (14) · 3048

DOI: 10.3390/electronics15143048 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 11.07.2026. Verfasst von Changliang Zhang und 3 weiteren Autor:innen. Die Arbeit nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Anhui Provincial Science and Technology Tackling Project for Traditional Chinese Medicine.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Accurate point-cloud registration is a fundamental task in intelligent 3D perception systems, including autonomous robotics, indoor digital twins, augmented reality, smart sensing, and scene-level spatial understanding. However, reliable registration in structured indoor environments remains challenging because repetitive architectural layouts, extensive planar regions, limited overlap, and rotational symmetries often weaken local geometric distinctiveness and lead to ambiguous correspondences. In addition, appearance inconsistency caused by illumination changes, exposure variation, and sensor-dependent color responses further degrades the reliability of cross-view matching. To address these issues, this paper presents MaCSE-Reg, an indoor registration method that combines explicit Manhattan-axis modeling with independent multi-color-space point-wise encoding. Rather than proposing a wholly new multi-modal paradigm, MaCSE-Reg builds on prior geometry–color fusion studies and focuses on two under-emphasized design choices for structured indoor scenes: (i) dominant orthogonal axes estimated from surface normals, regularized by an axis-consistency objective and gated by an axis-confidence score, and (ii) complementary RGB, Lab, and HSV representations learned through independent point-wise encoders for illumination-tolerant appearance matching. Geometric, structural, and color-aware features are adaptively fused, and a learnable multi-modal matching formulation is used to refine correspondences before weighted Procrustes pose estimation. Experiments on standard indoor registration benchmarks demonstrate that MaCSE-Reg improves registration robustness and pose accuracy under low-overlap conditions, repetitive structures, and illumination variations. The results support the value of this specific structural–appearance combination for intelligent indoor 3D perception while remaining complementary to existing geometry–color registration frameworks.

Förderung

  • Anhui Provincial Science and Technology Tackling Project for Traditional Chinese Medicine

Zitieren

APA

Zhang, C., Xu, Q., Sun, X., & Zhu, G. (2026). A Structure-Aware Multi-Modal Learning Framework for Robust Indoor Point-Cloud Registration. Electronics, 15(14), 3048. https://doi.org/10.3390/electronics15143048

Vancouver

Zhang C, Xu Q, Sun X, Zhu G. A Structure-Aware Multi-Modal Learning Framework for Robust Indoor Point-Cloud Registration. Electronics. 2026;15(14):3048. doi:10.3390/electronics15143048

BibTeX
@article{Zhang2026,
  author = {Zhang, Changliang and Xu, Qingshan and Sun, Xiongwei and Zhu, Gongqin},
  title = {A Structure-Aware Multi-Modal Learning Framework for Robust Indoor Point-Cloud Registration},
  journal = {Electronics},
  year = {2026},
  volume = {15},
  number = {14},
  pages = {3048},
  doi = {10.3390/electronics15143048}
}
Kostenlos starten →