Depth Completion and Inpainting for Specular Objects
IET Image Processing · 2025-01 · 19 (1)
DOI: 10.1049/ipr2.70049 ↗At a glance
Journal article in IET Image Processing, published online on 2025-04-02. Written by He Liu and 1 co-authors. Cited 1 times so far (Crossref); 51 references. The full text is freely available (open access, CC BY 4.0). Funded by: National Natural Science Foundation of China.
Abstract (original language)
Depth images or point clouds offer true three‐dimensional insights into scene geometry, making depth perception essential for downstream tasks in computer vision. However, current commercial depth sensors often produce dense estimations with lower accuracy, especially on specular surfaces, leading to noisy and incomplete data. To address this challenge, we propose a novel framework based on latent diffusion models conditioned on RGBD images and semantic labels for depth completion and inpainting, effectively restoring depth values for both visible and occluded parts of specular objects. We enhance geometric guidance by designing various visual descriptors as conditions and introduce channel and spatial attention mechanisms in the conditional encoder to improve multi‐modal feature fusion. Using the MP6D dataset, we render complete and dense depth images for benchmarking, enabling a comprehensive evaluation of our method against existing approaches. Extensive experiments demonstrate that our model outperforms previous methods, significantly improving the performance of downstream tasks by incorporating the predicted depth maps restored by our model.
Funding
- National Natural Science Foundation of China
Cite
APA
Liu, H., & Sun, Y. (2025). Depth Completion and Inpainting for Specular Objects. IET Image Processing, 19(1). https://doi.org/10.1049/ipr2.70049
Vancouver
Liu H, Sun Y. Depth Completion and Inpainting for Specular Objects. IET Image Processing. 2025;19(1). doi:10.1049/ipr2.70049
BibTeX
@article{Liu2025,
author = {Liu, He and Sun, Yi},
title = {Depth Completion and Inpainting for Specular Objects},
journal = {IET Image Processing},
year = {2025},
volume = {19},
number = {1},
doi = {10.1049/ipr2.70049}
}
EUVIMED