A lightweight speech enhancement network fusing bone- and air-conducted speech
The Journal of the Acoustical Society of America · 2024
DOI: 10.1121/10.0028339 ↗Kurz gefasst
Fachartikel in der Zeitschrift The Journal of the Acoustical Society of America, 2024. Verfasst von Kelan Kuang und 2 weiteren Autor:innen. Beteiligte Einrichtung: Key Laboratory of Noise and Vibration Research, Institute of Acoustics, Chinese Academy of Sciences, Beijing 100190, China. Hauptthemen laut MEDLINE: Noise, Bone Conduction. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 40 Literaturangaben. Gefördert von: Beijing Natural Science Foundation, National Natural Science Foundation of China, IACAS Frontier Exploration Project.
Abstract (Originalsprache)
Air-conducted (AC) microphones capture the high-quality desired speech and ambient noise, whereas bone-conducted (BC) microphones are immune to ambient noise but only capture band limited speech. This paper proposes a speech enhancement model that leverages the merits of BC and AC speech. The proposed model takes the spectrogram of BC and AC speech as input and fuses them by an attention-based feature fusion module. The backbone network of the proposed model uses the fused signals to estimate mask of the target speech, which is then applied to the noisy AC speech to recover the target speech. The proposed model adopts a lightweight design of densely gated convolutional attention network (DenGCAN) as the backbone network, which contains encoder, bottleneck layers, and decoder. Furthermore, this paper improves an attention gate and integrates it into skip-connections of DenGCAN, which allows the decoder to focus on the key areas of the feature map extracted by the encoder. As the DenGCAN adopts self-attention mechanism, the proposed model has the potential to improve noise reduction performance at the expense of an increased input-output latency. Experimental results demonstrate that the enhanced speech of the proposed model achieves an average 1.870 wideband-PESQ improvement over the noisy AC speech.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Key Laboratory of Noise and Vibration Research, Institute of Acoustics, Chinese Academy of Sciences, Beijing 100190, China.
- University of Chinese Academy of Sciences, Beijing 100049, China.
- State Key Laboratory of Acoustics, Institute of Acoustics, Chinese Academy of Sciences, Beijing 100190, China.
ORCID-Profile: Kelan Kuang, Feiran Yang, Jun Yang
Förderung
- Beijing Natural Science Foundation
- National Natural Science Foundation of China
- IACAS Frontier Exploration Project
Zitieren
APA
Kuang, K., Yang, F., & Yang, J. (2024). A lightweight speech enhancement network fusing bone- and air-conducted speech. The Journal of the Acoustical Society of America. https://doi.org/10.1121/10.0028339
Vancouver
Kuang K, Yang F, Yang J. A lightweight speech enhancement network fusing bone- and air-conducted speech. The Journal of the Acoustical Society of America. 2024. doi:10.1121/10.0028339
BibTeX
@article{Kuang2024,
author = {Kuang, Kelan and Yang, Feiran and Yang, Jun},
title = {A lightweight speech enhancement network fusing bone- and air-conducted speech},
journal = {The Journal of the Acoustical Society of America},
year = {2024},
doi = {10.1121/10.0028339}
}
EUVIMED