EUVIMEDOpdag EUVIMED
Crossref

Transparent Depth Completion Using Segmentation Features

Boqian Liu, Haojie Li, Zhihui Wang, Tianfan Xue

ACM Transactions on Multimedia Computing, Communications, and Applications · 2024-12-31 · 20 (12) · 1-19

DOI: 10.1145/3694978 ↗

At a glance

Journal article in ACM Transactions on Multimedia Computing, Communications, and Applications, published online on 2024-11-18. Written by Boqian Liu and 3 co-authors. Cited 13 times so far (Crossref); 55 references.

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Estimating the depth of transparent objects is one of the well-known challenges of RGB-D cameras due to the reflection and refraction effects. Previously, researchers propose to correct the depth of transparent objects by using their estimated segmentation masks because it is possible to recover the internal depth of an object just from its boundary, as illustrated by those depth-from-silhouette methods. However, these algorithms only use segmentation masks. They ignore the internal structure information from the mask segmentation features, which we argue are more useful for transparent depth estimation. In this work, we demonstrate the effectiveness of segmentation features for transparent object depth estimation. We show that it is even possible to recover the depth map just from segmentation features, without any RGB or depth map as input. Based on this observation, we propose DualTransNet which uses segmentation features for transparent depth completion. In our DualTransNet, we feed segmentation features from an extra module to the main network for better depth completion quality. Extensive experiments have shown the superiority of segmentation features as well as the state-of-the-art performance of our network.

Cite

APA

Liu, B., Li, H., Wang, Z., & Xue, T. (2024). Transparent Depth Completion Using Segmentation Features. ACM Transactions on Multimedia Computing, Communications, and Applications, 20(12), 1-19. https://doi.org/10.1145/3694978

Vancouver

Liu B, Li H, Wang Z, Xue T. Transparent Depth Completion Using Segmentation Features. ACM Transactions on Multimedia Computing, Communications, and Applications. 2024;20(12):1-19. doi:10.1145/3694978

BibTeX
@article{Liu2024,
  author = {Liu, Boqian and Li, Haojie and Wang, Zhihui and Xue, Tianfan},
  title = {Transparent Depth Completion Using Segmentation Features},
  journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
  year = {2024},
  volume = {20},
  number = {12},
  pages = {1--19},
  doi = {10.1145/3694978}
}
Start for free →