NeuroSonic: Instant Neural Impact Sound Synthesis With Learned Acoustic Transfer
Computer Animation and Virtual Worlds · 2026-07 · 37 (4)
DOI: 10.1002/cav.70162 ↗Kurz gefasst
Fachartikel in der Zeitschrift Computer Animation and Virtual Worlds, online erschienen am 07.07.2026. Verfasst von Junhan Zhao und 5 weiteren Autor:innen. Die Arbeit nennt 43 Literaturangaben. Gefördert von: National Key Research and Development Program of China.
Abstract (Originalsprache)
Physically based modal sound synthesis generates realistic audio by modeling structural vibration and acoustic radiation from object geometry and material properties. However, traditional approaches rely on computationally expensive eigenvalue analysis and acoustic transfer simulations, making them impractical for real‐time virtual reality (VR), especially for dynamically generated or fractured objects. We present NeuroSonic, a unified neural framework for real‐time physically based sound synthesis directly from point cloud geometry. Our key idea is to amortize modal analysis and acoustic transfer using neural networks, replacing costly numerical solvers with efficient feed‐forward inference. The framework predicts modal eigenvalues, eigenvectors, and acoustic transfer functions, forming a physically grounded representation for sound synthesis. By operating on point clouds, our method avoids voxelization artifacts and handles geometrically complex and thin structures. Once trained, NeuroSonic computes complete modal and acoustic information in under 0.02 s, enabling real‐time performance. Experiments show that our approach achieves accuracy comparable to physically based solvers while providing orders‐of‐magnitude speedup, making it a practical solution for interactive VR environments.
Förderung
- National Key Research and Development Program of China
Zitieren
APA
Zhao, J., Huang, Y., Jin, X., Zhu, F., Gai, M., & Li, S. (2026). NeuroSonic: Instant Neural Impact Sound Synthesis With Learned Acoustic Transfer. Computer Animation and Virtual Worlds, 37(4). https://doi.org/10.1002/cav.70162
Vancouver
Zhao J, Huang Y, Jin X, Zhu F, Gai M, Li S. NeuroSonic: Instant Neural Impact Sound Synthesis With Learned Acoustic Transfer. Computer Animation and Virtual Worlds. 2026;37(4). doi:10.1002/cav.70162
BibTeX
@article{Zhao2026,
author = {Zhao, Junhan and Huang, Yiming and Jin, Xutong and Zhu, Fei and Gai, Meng and Li, Sheng},
title = {NeuroSonic: Instant Neural Impact Sound Synthesis With Learned Acoustic Transfer},
journal = {Computer Animation and Virtual Worlds},
year = {2026},
volume = {37},
number = {4},
doi = {10.1002/cav.70162}
}
EUVIMED