EUVIMEDEUVIMED entdecken
Crossref

A lightweight speech enhancement network fusing bone- and air-conducted speech

Kelan Kuang iD, Feiran Yang iD, Jun Yang iD

The Journal of the Acoustical Society of America · 2024

DOI: 10.1121/10.0028339 ↗

Kurz gefasst

Fachartikel in der Zeitschrift The Journal of the Acoustical Society of America, 2024. Verfasst von Kelan Kuang und 2 weiteren Autor:innen. Beteiligte Einrichtung: Key Laboratory of Noise and Vibration Research, Institute of Acoustics, Chinese Academy of Sciences, Beijing 100190, China. Hauptthemen laut MEDLINE: Noise, Bone Conduction. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 40 Literaturangaben. Gefördert von: Beijing Natural Science Foundation, National Natural Science Foundation of China, IACAS Frontier Exploration Project.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Air-conducted (AC) microphones capture the high-quality desired speech and ambient noise, whereas bone-conducted (BC) microphones are immune to ambient noise but only capture band limited speech. This paper proposes a speech enhancement model that leverages the merits of BC and AC speech. The proposed model takes the spectrogram of BC and AC speech as input and fuses them by an attention-based feature fusion module. The backbone network of the proposed model uses the fused signals to estimate mask of the target speech, which is then applied to the noisy AC speech to recover the target speech. The proposed model adopts a lightweight design of densely gated convolutional attention network (DenGCAN) as the backbone network, which contains encoder, bottleneck layers, and decoder. Furthermore, this paper improves an attention gate and integrates it into skip-connections of DenGCAN, which allows the decoder to focus on the key areas of the feature map extracted by the encoder. As the DenGCAN adopts self-attention mechanism, the proposed model has the potential to improve noise reduction performance at the expense of an increased input-output latency. Experimental results demonstrate that the enhanced speech of the proposed model achieves an average 1.870 wideband-PESQ improvement over the noisy AC speech.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

NoiseBone ConductionHumansSignal-To-Noise RatioSignal Processing, Computer-AssistedSpeech PerceptionNeural Networks, ComputerSound Spectrography

Autor:innen und Institutionen

  • Key Laboratory of Noise and Vibration Research, Institute of Acoustics, Chinese Academy of Sciences, Beijing 100190, China.
  • University of Chinese Academy of Sciences, Beijing 100049, China.
  • State Key Laboratory of Acoustics, Institute of Acoustics, Chinese Academy of Sciences, Beijing 100190, China.

ORCID-Profile: Kelan Kuang, Feiran Yang, Jun Yang

Förderung

  • Beijing Natural Science Foundation
  • National Natural Science Foundation of China
  • IACAS Frontier Exploration Project

Zitieren

APA

Kuang, K., Yang, F., & Yang, J. (2024). A lightweight speech enhancement network fusing bone- and air-conducted speech. The Journal of the Acoustical Society of America. https://doi.org/10.1121/10.0028339

Vancouver

Kuang K, Yang F, Yang J. A lightweight speech enhancement network fusing bone- and air-conducted speech. The Journal of the Acoustical Society of America. 2024. doi:10.1121/10.0028339

BibTeX
@article{Kuang2024,
  author = {Kuang, Kelan and Yang, Feiran and Yang, Jun},
  title = {A lightweight speech enhancement network fusing bone- and air-conducted speech},
  journal = {The Journal of the Acoustical Society of America},
  year = {2024},
  doi = {10.1121/10.0028339}
}
Kostenlos starten →