EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

ProM-Pose: Language-Guided Zero-Shot 9-DoF Object Pose Estimation from RGB-D with Generative 3D Priors

Yuchen Li, Kai Qin, Haitao Wu, Xiangjun Qu

Electronics · 07.03.2026 · 15 (5) · 1111

DOI: 10.3390/electronics15051111 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 07.03.2026. Verfasst von Yuchen Li und 3 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 73 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Key Research and Development Program of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Object pose estimation is fundamental for robotic manipulation, autonomous driving, and augmented reality, yet recovering the full 9-DoF state (rotation, translation, and anisotropic 3D scale) from RGB-D observations remains challenging for previously unseen objects. Existing methods either rely on instance-specific CAD models, predefined category boundaries, or suffer from scale ambiguity under sparse observations. We propose ProM-Pose, a unified cross-modal temporal perception framework for zero-shot 9-DoF object pose estimation. By integrating language-conditioned generative 3D shape priors as canonical geometric references, an asymmetric cross-modal attention mechanism for spatially aware fusion, and a decoupled pose decoding strategy with temporal refinement, ProM-Pose constructs metrically consistent and semantically grounded representations without relying on category-specific pose priors or instance-level CAD supervision. Extensive experiments on CAMERA25 and REAL275 benchmarks demonstrate that ProM-Pose achieves competitive or superior performance compared to category-level methods, with mAP of 75.0% at 5°,2cm and 90.5% at 10°,5cm on CAMERA25, and 42.2% at 5°,2cm and 76.0% at 10°,5cm on REAL275 under zero-shot cross-domain evaluation. Qualitative results on real-world logistics scenarios further validate temporal stability and robustness under occlusion and lighting variations. ProM-Pose effectively bridges semantic grounding and metric geometric reasoning within a unified formulation, enabling stable and scale-aware 9-DoF pose estimation for previously unseen objects under open-vocabulary conditions.

Förderung

  • National Key Research and Development Program of China

Zitieren

APA

Li, Y., Qin, K., Wu, H., & Qu, X. (2026). ProM-Pose: Language-Guided Zero-Shot 9-DoF Object Pose Estimation from RGB-D with Generative 3D Priors. Electronics, 15(5), 1111. https://doi.org/10.3390/electronics15051111

Vancouver

Li Y, Qin K, Wu H, Qu X. ProM-Pose: Language-Guided Zero-Shot 9-DoF Object Pose Estimation from RGB-D with Generative 3D Priors. Electronics. 2026;15(5):1111. doi:10.3390/electronics15051111

BibTeX
@article{Li2026,
  author = {Li, Yuchen and Qin, Kai and Wu, Haitao and Qu, Xiangjun},
  title = {ProM-Pose: Language-Guided Zero-Shot 9-DoF Object Pose Estimation from RGB-D with Generative 3D Priors},
  journal = {Electronics},
  year = {2026},
  volume = {15},
  number = {5},
  pages = {1111},
  doi = {10.3390/electronics15051111}
}
Kostenlos starten →