Depth Completion and Inpainting for Specular Objects
IET Image Processing · 2025-01 · 19 (1)
DOI: 10.1049/ipr2.70049 ↗Kurz gefasst
Fachartikel in der Zeitschrift IET Image Processing, online erschienen am 02.04.2025. Verfasst von He Liu und 1 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 51 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
Depth images or point clouds offer true three‐dimensional insights into scene geometry, making depth perception essential for downstream tasks in computer vision. However, current commercial depth sensors often produce dense estimations with lower accuracy, especially on specular surfaces, leading to noisy and incomplete data. To address this challenge, we propose a novel framework based on latent diffusion models conditioned on RGBD images and semantic labels for depth completion and inpainting, effectively restoring depth values for both visible and occluded parts of specular objects. We enhance geometric guidance by designing various visual descriptors as conditions and introduce channel and spatial attention mechanisms in the conditional encoder to improve multi‐modal feature fusion. Using the MP6D dataset, we render complete and dense depth images for benchmarking, enabling a comprehensive evaluation of our method against existing approaches. Extensive experiments demonstrate that our model outperforms previous methods, significantly improving the performance of downstream tasks by incorporating the predicted depth maps restored by our model.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Liu, H., & Sun, Y. (2025). Depth Completion and Inpainting for Specular Objects. IET Image Processing, 19(1). https://doi.org/10.1049/ipr2.70049
Vancouver
Liu H, Sun Y. Depth Completion and Inpainting for Specular Objects. IET Image Processing. 2025;19(1). doi:10.1049/ipr2.70049
BibTeX
@article{Liu2025,
author = {Liu, He and Sun, Yi},
title = {Depth Completion and Inpainting for Specular Objects},
journal = {IET Image Processing},
year = {2025},
volume = {19},
number = {1},
doi = {10.1049/ipr2.70049}
}
EUVIMED