EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

An End-To-End Speech Recognition Model for the North Shaanxi Dialect: Design and Evaluation

Yi Qin iD, Feifan Yu

Sensors · 2025

DOI: 10.3390/s25020341 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, 2025. Verfasst von Yi Qin und 1 weiteren Autor:innen. Beteiligte Einrichtung: College of Computer Science & Technology, Xi'an University of Science and Technology, Xi'an 710054, China. Hauptthemen laut MEDLINE: Speech Recognition Software, Speech. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Shaanxi Province Future Emerging Industry Field Key Core Technology Research Project: High Safety and High Reliability Unmanned Driving Key Technology and Appl….

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The coal mining industry in Northern Shaanxi is robust, with a prevalent use of the local dialect, known as “Shapu”, characterized by a distinct Northern Shaanxi accent. This study addresses the practical need for speech recognition in this dialect. We propose an end-to-end speech recognition model for the North Shaanxi dialect, leveraging the Conformer architecture. To tailor the model to the coal mining context, we developed a specialized corpus reflecting the phonetic characteristics of the dialect and its usage in the industry. We investigated feature extraction techniques suitable for the North Shaanxi dialect, focusing on the unique pronunciation of initial consonants and vowels. A preprocessing module was designed to accommodate the dialect’s rapid speech tempo and polyphonic nature, enhancing recognition performance. To enhance the decoder’s text generation capability, we replaced the Conformer decoder with a Transformer architecture. Additionally, to mitigate the computational demands of the model, we incorporated Connectionist Temporal Classification (CTC) joint training for optimization. The experimental results on our self-established voice dataset for the Northern Shaanxi coal mining industry demonstrate that the proposed Conformer–Transformer–CTC model achieves a 9.2% and 10.3% reduction in the word error rate compared to the standalone Conformer and Transformer models, respectively, confirming the advancement of our method. The next step will involve researching how to improve the performance of dialect speech recognition by integrating external language models and extracting pronunciation features of different dialects, thereby achieving better recognition results.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Speech Recognition SoftwareSpeechHumansPhoneticsCoal MiningAlgorithmsLanguage

Stichwörter der Autor:innen

Conformer modelConnectionist Temporal Classification (CTC)Transformer modelcoal mining industrydialect speech recognitionend to end

Autor:innen und Institutionen

  • College of Computer Science & Technology, Xi'an University of Science and Technology, Xi'an 710054, China.
  • SHCCIG Yubei Coal Industry Co., Ltd., Xi'an 710900, China.

ORCID-Profile: Yi Qin

Förderung

  • Shaanxi Province Future Emerging Industry Field Key Core Technology Research Project: High Safety and High Reliability Unmanned Driving Key Technology and Appl…

Zitieren

APA

Qin, Y., & Yu, F. (2025). An End-To-End Speech Recognition Model for the North Shaanxi Dialect: Design and Evaluation. Sensors. https://doi.org/10.3390/s25020341

Vancouver

Qin Y, Yu F. An End-To-End Speech Recognition Model for the North Shaanxi Dialect: Design and Evaluation. Sensors. 2025. doi:10.3390/s25020341

BibTeX
@article{Qin2025,
  author = {Qin, Yi and Yu, Feifan},
  title = {An End-To-End Speech Recognition Model for the North Shaanxi Dialect: Design and Evaluation},
  journal = {Sensors},
  year = {2025},
  doi = {10.3390/s25020341}
}
Kostenlos starten →