EUVIMEDEUVIMED entdecken
Crossref

Self-Supervised Multi-Camera Collaborative Depth Prediction With Latent Diffusion Models

Jialei Xu, Xianming Liu, Yuanchao Bai, Junjun Jiang, Xiangyang Ji

IEEE Transactions on Intelligent Transportation Systems · 2025-07 · 26 (7) · 9609-9624

DOI: 10.1109/tits.2025.3571027 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Intelligent Transportation Systems, 2025-07. Verfasst von Jialei Xu und 4 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 78 Literaturangaben. Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Depth map estimation from images is a crucial task in self-driving applications. Existing methods can be categorized into two groups: multi-view stereo and monocular depth estimation. The former requires cameras to have large overlapping areas and a sufficient baseline between them, while the latter that processes each image independently can hardly guarantee the structure consistency between cameras. In this paper, we propose a novel self-supervised multi-camera collaborative depth prediction method with latent diffusion models, which does not require large overlapping areas while maintaining structure consistency between cameras. Specifically, we introduce MCDP, a new generative foundation model for estimating depth attributes for multi-cameras. We formulate the depth estimation as a weighted combination of depth bases, in which the weights are updated iteratively by the recurrent refinement strategy. During the iterative update, the results of depth estimation are compared across cameras, and the information of overlapping areas is propagated to the whole depth maps with the help of basis formulation in diffusion process. We integrate the GRU-based Weight Net into the diffusion process, allowing the refined hidden state to serve as a conditional input to accurately control the next iterative denoising step. Furthermore, by incorporating the proposed depth consistency loss, we ensure structural consistency across cameras, even in regions with minimal overlap. Experimental results on DDAD, NuScenes, Cityscapes, and Waymo Open Datasets demonstrate the superior performance of our method, and show great help for the downstream task.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Xu, J., Liu, X., Bai, Y., Jiang, J., & Ji, X. (2025). Self-Supervised Multi-Camera Collaborative Depth Prediction With Latent Diffusion Models. IEEE Transactions on Intelligent Transportation Systems, 26(7), 9609-9624. https://doi.org/10.1109/tits.2025.3571027

Vancouver

Xu J, Liu X, Bai Y, Jiang J, Ji X. Self-Supervised Multi-Camera Collaborative Depth Prediction With Latent Diffusion Models. IEEE Transactions on Intelligent Transportation Systems. 2025;26(7):9609-9624. doi:10.1109/tits.2025.3571027

BibTeX
@article{Xu2025,
  author = {Xu, Jialei and Liu, Xianming and Bai, Yuanchao and Jiang, Junjun and Ji, Xiangyang},
  title = {Self-Supervised Multi-Camera Collaborative Depth Prediction With Latent Diffusion Models},
  journal = {IEEE Transactions on Intelligent Transportation Systems},
  year = {2025},
  volume = {26},
  number = {7},
  pages = {9609--9624},
  doi = {10.1109/tits.2025.3571027}
}
Kostenlos starten →