Single-point optical-vibration sensing system for deep-learning-based stereo sound synthesis
The Journal of the Acoustical Society of America · 01.08.2026 · 160 (2) · 1011-1023
DOI: 10.1121/10.0044507 ↗Kurz gefasst
Fachartikel in der Zeitschrift The Journal of the Acoustical Society of America, online erschienen am 03.08.2026. Verfasst von Kuo-Wei Chao und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biomedical Engineering, National Yang Ming Chiao Tung University, Taiwan. Die Arbeit nennt 52 Literaturangaben. Gefördert von: National Science and Technology Council.
Abstract (Originalsprache)
Stereo sound enhances the ability to identify the locations of sound sources, thereby enriching the auditory experience. The prevalent method for stereo recording involves using a microphone array, but this approach encounters challenges related to distance, ambient noise, and equipment setup complexity. To address these limitations, this paper proposes a deep-learning-based stereo sound synthesis system using a laser Doppler vibrometer. This study verifies that these monophonic vibration signals contain encoded binaural hearing cues, particularly the interaural level difference and interaural time difference. The proposed system leverages a gated convolutional neural network to synthesize stereo sound from these signals. The system achieves directional sound reconstruction from single-point vibration data with recognition rates of 97.7%–98.8%. The results of a stereo music synthesis experiment confirmed the effectiveness of the system, indicating scale-invariant signal-to-distortion ratio improvements of 2.64 and 3.52 for inside and outside tests, respectively. Subjective evaluations showed significant enhancements, with the mean opinion score for pleasantness and stereoscopic sense increasing by 44.5% and 57.0%, respectively.
Autor:innen und Institutionen
- Department of Biomedical Engineering, National Yang Ming Chiao Tung University, Taiwan.
- Country Medical Device Innovation and Translation Center, National Yang Ming Chiao Tung University, Taiwan.
Förderung
- National Science and Technology Council
Zitieren
APA
Chao, K. W., Han, J. Y., Chen, J. W., Lin, Y. C., & Lai, Y. H. (2026). Single-point optical-vibration sensing system for deep-learning-based stereo sound synthesis. The Journal of the Acoustical Society of America, 160(2), 1011-1023. https://doi.org/10.1121/10.0044507
Vancouver
Chao KW, Han JY, Chen JW, Lin YC, Lai YH. Single-point optical-vibration sensing system for deep-learning-based stereo sound synthesis. The Journal of the Acoustical Society of America. 2026;160(2):1011-1023. doi:10.1121/10.0044507
BibTeX
@article{Chao2026,
author = {Chao, Kuo-Wei and Han, Ji-Yan and Chen, Jia-Wei and Lin, Yi-Chieh and Lai, Ying-Hui},
title = {Single-point optical-vibration sensing system for deep-learning-based stereo sound synthesis},
journal = {The Journal of the Acoustical Society of America},
year = {2026},
volume = {160},
number = {2},
pages = {1011--1023},
doi = {10.1121/10.0044507}
}
EUVIMED