Transparent Depth Completion Using Segmentation Features
ACM Transactions on Multimedia Computing, Communications, and Applications · 31.12.2024 · 20 (12) · 1-19
DOI: 10.1145/3694978 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Multimedia Computing, Communications, and Applications, online erschienen am 18.11.2024. Verfasst von Boqian Liu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 55 Literaturangaben.
Abstract (Originalsprache)
Estimating the depth of transparent objects is one of the well-known challenges of RGB-D cameras due to the reflection and refraction effects. Previously, researchers propose to correct the depth of transparent objects by using their estimated segmentation masks because it is possible to recover the internal depth of an object just from its boundary, as illustrated by those depth-from-silhouette methods. However, these algorithms only use segmentation masks. They ignore the internal structure information from the mask segmentation features, which we argue are more useful for transparent depth estimation. In this work, we demonstrate the effectiveness of segmentation features for transparent object depth estimation. We show that it is even possible to recover the depth map just from segmentation features, without any RGB or depth map as input. Based on this observation, we propose DualTransNet which uses segmentation features for transparent depth completion. In our DualTransNet, we feed segmentation features from an extra module to the main network for better depth completion quality. Extensive experiments have shown the superiority of segmentation features as well as the state-of-the-art performance of our network.
Zitieren
APA
Liu, B., Li, H., Wang, Z., & Xue, T. (2024). Transparent Depth Completion Using Segmentation Features. ACM Transactions on Multimedia Computing, Communications, and Applications, 20(12), 1-19. https://doi.org/10.1145/3694978
Vancouver
Liu B, Li H, Wang Z, Xue T. Transparent Depth Completion Using Segmentation Features. ACM Transactions on Multimedia Computing, Communications, and Applications. 2024;20(12):1-19. doi:10.1145/3694978
BibTeX
@article{Liu2024,
author = {Liu, Boqian and Li, Haojie and Wang, Zhihui and Xue, Tianfan},
title = {Transparent Depth Completion Using Segmentation Features},
journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
year = {2024},
volume = {20},
number = {12},
pages = {1--19},
doi = {10.1145/3694978}
}
EUVIMED