EUVIMEDObjevte EUVIMED
Open access · CC BY 4.0

Depth Completion and Inpainting for Specular Objects

He Liu, Yi Sun

IET Image Processing · 2025-01 · 19 (1)

DOI: 10.1049/ipr2.70049 ↗

At a glance

Journal article in IET Image Processing, published online on 2025-04-02. Written by He Liu and 1 co-authors. Cited 1 times so far (Crossref); 51 references. The full text is freely available (open access, CC BY 4.0). Funded by: National Natural Science Foundation of China.

AbstraktBibliografické údajeCiteRelated studies

Abstract (original language)

Depth images or point clouds offer true three‐dimensional insights into scene geometry, making depth perception essential for downstream tasks in computer vision. However, current commercial depth sensors often produce dense estimations with lower accuracy, especially on specular surfaces, leading to noisy and incomplete data. To address this challenge, we propose a novel framework based on latent diffusion models conditioned on RGBD images and semantic labels for depth completion and inpainting, effectively restoring depth values for both visible and occluded parts of specular objects. We enhance geometric guidance by designing various visual descriptors as conditions and introduce channel and spatial attention mechanisms in the conditional encoder to improve multi‐modal feature fusion. Using the MP6D dataset, we render complete and dense depth images for benchmarking, enabling a comprehensive evaluation of our method against existing approaches. Extensive experiments demonstrate that our model outperforms previous methods, significantly improving the performance of downstream tasks by incorporating the predicted depth maps restored by our model.

Funding

  • National Natural Science Foundation of China

Cite

APA

Liu, H., & Sun, Y. (2025). Depth Completion and Inpainting for Specular Objects. IET Image Processing, 19(1). https://doi.org/10.1049/ipr2.70049

Vancouver

Liu H, Sun Y. Depth Completion and Inpainting for Specular Objects. IET Image Processing. 2025;19(1). doi:10.1049/ipr2.70049

BibTeX
@article{Liu2025,
  author = {Liu, He and Sun, Yi},
  title = {Depth Completion and Inpainting for Specular Objects},
  journal = {IET Image Processing},
  year = {2025},
  volume = {19},
  number = {1},
  doi = {10.1049/ipr2.70049}
}
Start for free →