EUVIMEDEUVIMED entdecken
Crossref

Z-Splat: Z-Axis Gaussian Splatting for Camera-Sonar Fusion

Ziyuan Qu, Omkar Vengurlekar, Mohamad Qadri, Kevin Zhang, Michael Kaess, Christopher Metzler, Suren Jayasuriya, Adithya Pediredla

IEEE Transactions on Pattern Analysis and Machine Intelligence · 2025-09 · 47 (9) · 7255-7267

DOI: 10.1109/tpami.2024.3462290 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025-09. Verfasst von Ziyuan Qu und 7 weiteren Autor:innen. Die Arbeit wurde bisher 29-mal zitiert (Crossref) und nennt 54 Literaturangaben. Gefördert von: NSF, ONR, Raytheon, Inc.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Differentiable 3D-Gaussian splatting (GS) is emerging as a prominent technique in computer vision and graphics for reconstructing 3D scenes. GS represents a scene as a set of 3D Gaussians with varying opacities and employs a computationally efficient splatting operation along with analytical derivatives to compute the 3D Gaussian parameters given scene images captured from various viewpoints. Unfortunately, capturing surround view ($\text{360}^{\circ }$360∘ viewpoint) images is impossible or impractical in many real-world imaging scenarios, including underwater imaging, rooms inside a building, and autonomous navigation. In these restricted baseline imaging scenarios, the GS algorithm suffers from a well-known 'missing cone' problem, which results in poor reconstruction along the depth axis. In this paper, we demonstrate that using transient data (from sonars) allows us to address the missing cone problem by sampling high-frequency data along the depth axis. We extend the Gaussian splatting algorithms for two commonly used sonars and propose fusion algorithms that simultaneously utilize RGB camera data and sonar data. Through simulations, emulations, and hardware experiments across various imaging scenarios, we show that the proposed fusion algorithms lead to significantly better novel view synthesis (5 dB improvement in PSNR) and 3D geometry reconstruction (60% lower Chamfer distance).

Förderung

  • NSF
  • ONR
  • Raytheon, Inc
  • AFOSR Young Investigator Program
  • SAAB, Inc

Zitieren

APA

Qu, Z., Vengurlekar, O., Qadri, M., Zhang, K., Kaess, M., Metzler, C., Jayasuriya, S., & Pediredla, A. (2025). Z-Splat: Z-Axis Gaussian Splatting for Camera-Sonar Fusion. IEEE Transactions on Pattern Analysis and Machine Intelligence, 47(9), 7255-7267. https://doi.org/10.1109/tpami.2024.3462290

Vancouver

Qu Z, Vengurlekar O, Qadri M, Zhang K, Kaess M, Metzler C, et al. Z-Splat: Z-Axis Gaussian Splatting for Camera-Sonar Fusion. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2025;47(9):7255-7267. doi:10.1109/tpami.2024.3462290

BibTeX
@article{Qu2025,
  author = {Qu, Ziyuan and Vengurlekar, Omkar and Qadri, Mohamad and Zhang, Kevin and Kaess, Michael and Metzler, Christopher and Jayasuriya, Suren and Pediredla, Adithya},
  title = {Z-Splat: Z-Axis Gaussian Splatting for Camera-Sonar Fusion},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year = {2025},
  volume = {47},
  number = {9},
  pages = {7255--7267},
  doi = {10.1109/tpami.2024.3462290}
}
Kostenlos starten →