MAE-Based Dual Cross-Modality Relationship Learning for 6D Pose Estimation
IEEE Transactions on Consumer Electronics · 2026-05 · 72 (2) · 3710-3721
DOI: 10.1109/tce.2026.3672868 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Consumer Electronics, 2026-05. Verfasst von Hanxue Fu und 2 weiteren Autor:innen. Die Arbeit nennt 41 Literaturangaben. Gefördert von: Water Conservancy Science and Technology Project of Jiangsu Provincial Department of Water Resources, Fundamental Research Funds for the Central Universities, Key Project of the Jiangsu Provincial Basic Research Program.
Abstract (Originalsprache)
With the growing demand for high-precision spatial perception in consumer electronics, 6D pose estimation technology has become a core enabler for scenarios such as augmented reality and smart home systems. Accurate 6D pose estimation requires effective utilization of depth information and image data. However, most existing pose estimation methods for heterogeneous information fusion merely concatenate the data without considering the implicit correlations between different data distributions. This may increase the algorithm’s sensitivity to outliers and noise in complex environments with dynamic scenes or significant lighting changes. Additionally, redundant information inherent in cross-modality signal representations necessitates rational elimination. These limitations lead to algorithm instability in practical applications. To address these challenges, we propose a novel self-supervised learning method named Cross-modality Masked Autoencoder (CMAE). CMAE effectively integrates information from different sensor modalities by combining the strengths of mask autoencoders. At the same time, it employs a hierarchical cross-modality similarity extraction module to remove redundant information. Experiments show that our algorithm achieves an average accuracy of 90.1% on the Linemod-Occlude dataset and 94.8% on the YCB-Video dataset. These properties make CMAE particularly suitable for consumer electronics applications, where robust and efficient 6D pose estimation is critical.
Förderung
- Water Conservancy Science and Technology Project of Jiangsu Provincial Department of Water Resources
- Fundamental Research Funds for the Central Universities
- Key Project of the Jiangsu Provincial Basic Research Program
- Major Innovation Platform Plan of Jiangsu Provincial Department of Science and Technology
- General Program of the National Natural Science Foundation of China
Zitieren
APA
Fu, H., Lu, H., & Li, Y. (2026). MAE-Based Dual Cross-Modality Relationship Learning for 6D Pose Estimation. IEEE Transactions on Consumer Electronics, 72(2), 3710-3721. https://doi.org/10.1109/tce.2026.3672868
Vancouver
Fu H, Lu H, Li Y. MAE-Based Dual Cross-Modality Relationship Learning for 6D Pose Estimation. IEEE Transactions on Consumer Electronics. 2026;72(2):3710-3721. doi:10.1109/tce.2026.3672868
BibTeX
@article{Fu2026,
author = {Fu, Hanxue and Lu, Huimin and Li, Yujie},
title = {MAE-Based Dual Cross-Modality Relationship Learning for 6D Pose Estimation},
journal = {IEEE Transactions on Consumer Electronics},
year = {2026},
volume = {72},
number = {2},
pages = {3710--3721},
doi = {10.1109/tce.2026.3672868}
}
EUVIMED