EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Exploring and Addressing Low-Quality Auxiliary Modality in Earable Dual-microphone Speech Enhancement

Feiyu Han, Dawei Yan, Shanyue Wang, Jinyang Huang, Yuanhao Feng, Panlong Yang

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · 15.06.2026 · 10 (2) · 1-26

DOI: 10.1145/3810214 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, online erschienen am 15.06.2026. Verfasst von Feiyu Han und 5 weiteren Autor:innen. Die Arbeit nennt 53 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Basic Research Program of Jiangsu, National Natural Science Foundation of China, Jiangsu Province Higher Education Basic Science (Natural Science) Research Program.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

To enhance the speech clarity in earable voice interaction scenarios, dual-microphone speech enhancement (SE) techniques with collaboration of in-ear and out-ear microphones have garnered significant attention from the research community. Nevertheless, existing dual-microphone SE techniques are established on a strong assumption: high-quality in-ear speech (auxiliary modality) could provide efficient complementary information to target airborne speech (primary modality) , which decreases the adaptation in the real world. In our work, we explore a key observation that air pressure imbalance caused by ear canal deformation (ECD) adversely affects the quality of in-ear speech, subsequently leading to a significant degradation in speech enhancement performance. To address this bottleneck issue, we design an efficient quality-aware speech enhancement solution, named QuaSE, which efficiently and dynamically fuses complementary information by assessing the quality variations of in-ear speech. Additionally, based on the analysis of spectral distortion induced by ECD, a training strategy including quality-aware data selection and content-aware augmentation is designed to improve the generalization capability of QuaSE. Extensive experiments demonstrate that QuaSE outperforms state-of-the-art techniques by 6.27%, 4.54%, 14.90%, and 11.93% in terms of PESQ, STOI, SI-SDR, and SegSNR. Moreover, we also validate that the proposed quality-aware fusion strategy can be modularly integrated into other sensing tasks, improving the fusion performance.

Förderung

  • Basic Research Program of Jiangsu
  • National Natural Science Foundation of China
  • Jiangsu Province Higher Education Basic Science (Natural Science) Research Program
  • Pioneer and Leading Goose? R&D Program of Zhejiang

Zitieren

APA

Han, F., Yan, D., Wang, S., Huang, J., Feng, Y., & Yang, P. (2026). Exploring and Addressing Low-Quality Auxiliary Modality in Earable Dual-microphone Speech Enhancement. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 10(2), 1-26. https://doi.org/10.1145/3810214

Vancouver

Han F, Yan D, Wang S, Huang J, Feng Y, Yang P. Exploring and Addressing Low-Quality Auxiliary Modality in Earable Dual-microphone Speech Enhancement. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies. 2026;10(2):1-26. doi:10.1145/3810214

BibTeX
@article{Han2026,
  author = {Han, Feiyu and Yan, Dawei and Wang, Shanyue and Huang, Jinyang and Feng, Yuanhao and Yang, Panlong},
  title = {Exploring and Addressing Low-Quality Auxiliary Modality in Earable Dual-microphone Speech Enhancement},
  journal = {Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies},
  year = {2026},
  volume = {10},
  number = {2},
  pages = {1--26},
  doi = {10.1145/3810214}
}
Kostenlos starten →