EUVIMEDEUVIMED entdecken
Crossref

NeuroSonic: Instant Neural Impact Sound Synthesis With Learned Acoustic Transfer

Junhan Zhao, Yiming Huang, Xutong Jin, Fei Zhu, Meng Gai, Sheng Li

Computer Animation and Virtual Worlds · 2026-07 · 37 (4)

DOI: 10.1002/cav.70162 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computer Animation and Virtual Worlds, online erschienen am 07.07.2026. Verfasst von Junhan Zhao und 5 weiteren Autor:innen. Die Arbeit nennt 43 Literaturangaben. Gefördert von: National Key Research and Development Program of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Physically based modal sound synthesis generates realistic audio by modeling structural vibration and acoustic radiation from object geometry and material properties. However, traditional approaches rely on computationally expensive eigenvalue analysis and acoustic transfer simulations, making them impractical for real‐time virtual reality (VR), especially for dynamically generated or fractured objects. We present NeuroSonic, a unified neural framework for real‐time physically based sound synthesis directly from point cloud geometry. Our key idea is to amortize modal analysis and acoustic transfer using neural networks, replacing costly numerical solvers with efficient feed‐forward inference. The framework predicts modal eigenvalues, eigenvectors, and acoustic transfer functions, forming a physically grounded representation for sound synthesis. By operating on point clouds, our method avoids voxelization artifacts and handles geometrically complex and thin structures. Once trained, NeuroSonic computes complete modal and acoustic information in under 0.02 s, enabling real‐time performance. Experiments show that our approach achieves accuracy comparable to physically based solvers while providing orders‐of‐magnitude speedup, making it a practical solution for interactive VR environments.

Förderung

  • National Key Research and Development Program of China

Zitieren

APA

Zhao, J., Huang, Y., Jin, X., Zhu, F., Gai, M., & Li, S. (2026). NeuroSonic: Instant Neural Impact Sound Synthesis With Learned Acoustic Transfer. Computer Animation and Virtual Worlds, 37(4). https://doi.org/10.1002/cav.70162

Vancouver

Zhao J, Huang Y, Jin X, Zhu F, Gai M, Li S. NeuroSonic: Instant Neural Impact Sound Synthesis With Learned Acoustic Transfer. Computer Animation and Virtual Worlds. 2026;37(4). doi:10.1002/cav.70162

BibTeX
@article{Zhao2026,
  author = {Zhao, Junhan and Huang, Yiming and Jin, Xutong and Zhu, Fei and Gai, Meng and Li, Sheng},
  title = {NeuroSonic: Instant Neural Impact Sound Synthesis With Learned Acoustic Transfer},
  journal = {Computer Animation and Virtual Worlds},
  year = {2026},
  volume = {37},
  number = {4},
  doi = {10.1002/cav.70162}
}
Kostenlos starten →