EUVIMEDEUVIMED entdecken
Crossref

Single-point optical-vibration sensing system for deep-learning-based stereo sound synthesis

Kuo-Wei Chao, Ji-Yan Han, Jia-Wei Chen, Yi-Chieh Lin, Ying-Hui Lai

The Journal of the Acoustical Society of America · 01.08.2026 · 160 (2) · 1011-1023

DOI: 10.1121/10.0044507 ↗

Kurz gefasst

Fachartikel in der Zeitschrift The Journal of the Acoustical Society of America, online erschienen am 03.08.2026. Verfasst von Kuo-Wei Chao und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biomedical Engineering, National Yang Ming Chiao Tung University, Taiwan. Die Arbeit nennt 52 Literaturangaben. Gefördert von: National Science and Technology Council.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Stereo sound enhances the ability to identify the locations of sound sources, thereby enriching the auditory experience. The prevalent method for stereo recording involves using a microphone array, but this approach encounters challenges related to distance, ambient noise, and equipment setup complexity. To address these limitations, this paper proposes a deep-learning-based stereo sound synthesis system using a laser Doppler vibrometer. This study verifies that these monophonic vibration signals contain encoded binaural hearing cues, particularly the interaural level difference and interaural time difference. The proposed system leverages a gated convolutional neural network to synthesize stereo sound from these signals. The system achieves directional sound reconstruction from single-point vibration data with recognition rates of 97.7%–98.8%. The results of a stereo music synthesis experiment confirmed the effectiveness of the system, indicating scale-invariant signal-to-distortion ratio improvements of 2.64 and 3.52 for inside and outside tests, respectively. Subjective evaluations showed significant enhancements, with the mean opinion score for pleasantness and stereoscopic sense increasing by 44.5% and 57.0%, respectively.

Autor:innen und Institutionen

  • Department of Biomedical Engineering, National Yang Ming Chiao Tung University, Taiwan.
  • Country Medical Device Innovation and Translation Center, National Yang Ming Chiao Tung University, Taiwan.

Förderung

  • National Science and Technology Council

Zitieren

APA

Chao, K. W., Han, J. Y., Chen, J. W., Lin, Y. C., & Lai, Y. H. (2026). Single-point optical-vibration sensing system for deep-learning-based stereo sound synthesis. The Journal of the Acoustical Society of America, 160(2), 1011-1023. https://doi.org/10.1121/10.0044507

Vancouver

Chao KW, Han JY, Chen JW, Lin YC, Lai YH. Single-point optical-vibration sensing system for deep-learning-based stereo sound synthesis. The Journal of the Acoustical Society of America. 2026;160(2):1011-1023. doi:10.1121/10.0044507

BibTeX
@article{Chao2026,
  author = {Chao, Kuo-Wei and Han, Ji-Yan and Chen, Jia-Wei and Lin, Yi-Chieh and Lai, Ying-Hui},
  title = {Single-point optical-vibration sensing system for deep-learning-based stereo sound synthesis},
  journal = {The Journal of the Acoustical Society of America},
  year = {2026},
  volume = {160},
  number = {2},
  pages = {1011--1023},
  doi = {10.1121/10.0044507}
}
Kostenlos starten →