Z-Splat: Z-Axis Gaussian Splatting for Camera-Sonar Fusion
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2025-09 · 47 (9) · 7255-7267
DOI: 10.1109/tpami.2024.3462290 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025-09. Verfasst von Ziyuan Qu und 7 weiteren Autor:innen. Die Arbeit wurde bisher 29-mal zitiert (Crossref) und nennt 54 Literaturangaben. Gefördert von: NSF, ONR, Raytheon, Inc.
Abstract (Originalsprache)
Differentiable 3D-Gaussian splatting (GS) is emerging as a prominent technique in computer vision and graphics for reconstructing 3D scenes. GS represents a scene as a set of 3D Gaussians with varying opacities and employs a computationally efficient splatting operation along with analytical derivatives to compute the 3D Gaussian parameters given scene images captured from various viewpoints. Unfortunately, capturing surround view ($\text{360}^{\circ }$360∘ viewpoint) images is impossible or impractical in many real-world imaging scenarios, including underwater imaging, rooms inside a building, and autonomous navigation. In these restricted baseline imaging scenarios, the GS algorithm suffers from a well-known 'missing cone' problem, which results in poor reconstruction along the depth axis. In this paper, we demonstrate that using transient data (from sonars) allows us to address the missing cone problem by sampling high-frequency data along the depth axis. We extend the Gaussian splatting algorithms for two commonly used sonars and propose fusion algorithms that simultaneously utilize RGB camera data and sonar data. Through simulations, emulations, and hardware experiments across various imaging scenarios, we show that the proposed fusion algorithms lead to significantly better novel view synthesis (5 dB improvement in PSNR) and 3D geometry reconstruction (60% lower Chamfer distance).
Förderung
- NSF
- ONR
- Raytheon, Inc
- AFOSR Young Investigator Program
- SAAB, Inc
Zitieren
APA
Qu, Z., Vengurlekar, O., Qadri, M., Zhang, K., Kaess, M., Metzler, C., Jayasuriya, S., & Pediredla, A. (2025). Z-Splat: Z-Axis Gaussian Splatting for Camera-Sonar Fusion. IEEE Transactions on Pattern Analysis and Machine Intelligence, 47(9), 7255-7267. https://doi.org/10.1109/tpami.2024.3462290
Vancouver
Qu Z, Vengurlekar O, Qadri M, Zhang K, Kaess M, Metzler C, et al. Z-Splat: Z-Axis Gaussian Splatting for Camera-Sonar Fusion. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2025;47(9):7255-7267. doi:10.1109/tpami.2024.3462290
BibTeX
@article{Qu2025,
author = {Qu, Ziyuan and Vengurlekar, Omkar and Qadri, Mohamad and Zhang, Kevin and Kaess, Michael and Metzler, Christopher and Jayasuriya, Suren and Pediredla, Adithya},
title = {Z-Splat: Z-Axis Gaussian Splatting for Camera-Sonar Fusion},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2025},
volume = {47},
number = {9},
pages = {7255--7267},
doi = {10.1109/tpami.2024.3462290}
}
EUVIMED