EUVIMEDEUVIMED entdecken
Crossref

MAE-Based Dual Cross-Modality Relationship Learning for 6D Pose Estimation

Hanxue Fu, Huimin Lu, Yujie Li

IEEE Transactions on Consumer Electronics · 2026-05 · 72 (2) · 3710-3721

DOI: 10.1109/tce.2026.3672868 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Consumer Electronics, 2026-05. Verfasst von Hanxue Fu und 2 weiteren Autor:innen. Die Arbeit nennt 41 Literaturangaben. Gefördert von: Water Conservancy Science and Technology Project of Jiangsu Provincial Department of Water Resources, Fundamental Research Funds for the Central Universities, Key Project of the Jiangsu Provincial Basic Research Program.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

With the growing demand for high-precision spatial perception in consumer electronics, 6D pose estimation technology has become a core enabler for scenarios such as augmented reality and smart home systems. Accurate 6D pose estimation requires effective utilization of depth information and image data. However, most existing pose estimation methods for heterogeneous information fusion merely concatenate the data without considering the implicit correlations between different data distributions. This may increase the algorithm’s sensitivity to outliers and noise in complex environments with dynamic scenes or significant lighting changes. Additionally, redundant information inherent in cross-modality signal representations necessitates rational elimination. These limitations lead to algorithm instability in practical applications. To address these challenges, we propose a novel self-supervised learning method named Cross-modality Masked Autoencoder (CMAE). CMAE effectively integrates information from different sensor modalities by combining the strengths of mask autoencoders. At the same time, it employs a hierarchical cross-modality similarity extraction module to remove redundant information. Experiments show that our algorithm achieves an average accuracy of 90.1% on the Linemod-Occlude dataset and 94.8% on the YCB-Video dataset. These properties make CMAE particularly suitable for consumer electronics applications, where robust and efficient 6D pose estimation is critical.

Förderung

  • Water Conservancy Science and Technology Project of Jiangsu Provincial Department of Water Resources
  • Fundamental Research Funds for the Central Universities
  • Key Project of the Jiangsu Provincial Basic Research Program
  • Major Innovation Platform Plan of Jiangsu Provincial Department of Science and Technology
  • General Program of the National Natural Science Foundation of China

Zitieren

APA

Fu, H., Lu, H., & Li, Y. (2026). MAE-Based Dual Cross-Modality Relationship Learning for 6D Pose Estimation. IEEE Transactions on Consumer Electronics, 72(2), 3710-3721. https://doi.org/10.1109/tce.2026.3672868

Vancouver

Fu H, Lu H, Li Y. MAE-Based Dual Cross-Modality Relationship Learning for 6D Pose Estimation. IEEE Transactions on Consumer Electronics. 2026;72(2):3710-3721. doi:10.1109/tce.2026.3672868

BibTeX
@article{Fu2026,
  author = {Fu, Hanxue and Lu, Huimin and Li, Yujie},
  title = {MAE-Based Dual Cross-Modality Relationship Learning for 6D Pose Estimation},
  journal = {IEEE Transactions on Consumer Electronics},
  year = {2026},
  volume = {72},
  number = {2},
  pages = {3710--3721},
  doi = {10.1109/tce.2026.3672868}
}
Kostenlos starten →