EUVIMEDEUVIMED entdecken
Crossref

Rethinking Transparent Object Grasping: Depth Completion With Monocular Depth Estimation and Instance Mask

Yaofeng Cheng, Xinkai Gao, Sen Zhang, Chao Zeng, Fusheng Zha, Lining Sun, Chenguang Yang

IEEE Robotics and Automation Letters · 2026-05 · 11 (5) · 5510-5517

DOI: 10.1109/lra.2026.3673898 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Robotics and Automation Letters, 2026-05. Verfasst von Yaofeng Cheng und 6 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 33 Literaturangaben. Gefördert von: National Key R&D Program of China, Self-Planned Task, State Key Laboratory of Robotics and System.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Accurate depth maps are essential for robotic grasping. However, transparent objects often cause depth cameras to produce missing or distorted depth due to reflection and refraction, making grasping them particularly challenging. Precise depth estimation for transparent objects is therefore crucial. Existing end-to-end methods aim to predict depth directly from RGB-D inputs. However, depth distortion varies significantly with environment, viewpoint, and illumination, making it difficult to predict. Models trained on limited datasets often fail to generalize effectively in real-world applications. In this letter, we propose ReMake, a novel transparent object depth completion framework that injects structured priors to reformulate the depth estimation learning objective. First, we introduce a mask prior to explicitly separate transparent regions from reliable background depth. This separation ensures consistency between training and real-world application, where masked areas correspond to transparent regions and unmasked areas to opaque ones. This improves the model's generalizability in real-world applications. Second, we further incorporate relative depth as an additional prior obtained from monocular depth estimation, which encodes the depth relationship between transparent objects and their background to guide the reconstruction of transparent regions more effectively. Extensive experiments across datasets and real-world scenes demonstrate that ReMake significantly outperforms existing methods, especially in different-view prediction experiments, evaluating its generalizability.

Förderung

  • National Key R&D Program of China
  • Self-Planned Task
  • State Key Laboratory of Robotics and System
  • Suzhou Science and Technology Development Plan
  • Science and Technology Innovation
  • Major Project on Intelligent Manufacturing Systems and Robots

Zitieren

APA

Cheng, Y., Gao, X., Zhang, S., Zeng, C., Zha, F., Sun, L., & Yang, C. (2026). Rethinking Transparent Object Grasping: Depth Completion With Monocular Depth Estimation and Instance Mask. IEEE Robotics and Automation Letters, 11(5), 5510-5517. https://doi.org/10.1109/lra.2026.3673898

Vancouver

Cheng Y, Gao X, Zhang S, Zeng C, Zha F, Sun L, et al. Rethinking Transparent Object Grasping: Depth Completion With Monocular Depth Estimation and Instance Mask. IEEE Robotics and Automation Letters. 2026;11(5):5510-5517. doi:10.1109/lra.2026.3673898

BibTeX
@article{Cheng2026,
  author = {Cheng, Yaofeng and Gao, Xinkai and Zhang, Sen and Zeng, Chao and Zha, Fusheng and Sun, Lining and Yang, Chenguang},
  title = {Rethinking Transparent Object Grasping: Depth Completion With Monocular Depth Estimation and Instance Mask},
  journal = {IEEE Robotics and Automation Letters},
  year = {2026},
  volume = {11},
  number = {5},
  pages = {5510--5517},
  doi = {10.1109/lra.2026.3673898}
}
Kostenlos starten →