EUVIMEDEUVIMED entdecken
Crossref

Error correction for Japanese automatic speech recognition by large language model incorporating pitch accent information

Momone Suzuki, Sei Ueno, Akinobu Lee

The Journal of the Acoustical Society of America · 01.10.2025 · 158 (4_Supplement) · A136-A136

DOI: 10.1121/10.0040372 ↗

Kurz gefasst

Fachartikel in der Zeitschrift The Journal of the Acoustical Society of America, erschienen am 01.10.2025. Verfasst von Momone Suzuki und 2 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recent studies have shown the effectiveness of large language models (LLMs) in error correction for automatic speech recognition (ASR). However, existing LLM based error correction approaches use only textual information and neglect pitch accent information, which leads to over-correction. In Japanese language, there are the words, such as “Hashi (Chopsticks)” and “Hashi (Bridge),” that can be distinguished by the difference of the pitch accent and the pitch accent information is important for error correction in Japanese ASR. In this paper, we investigate the use of pre-trained LLM to improve the outputs of Japanese ASR. In particular, we aim to improve error correction by using the N-best hypotheses and pitch accent information generated by ASR as input to LLM. We fine-tune the LLM and design an input prompt to the LLM by combining the N-best hypotheses and the corresponding pitch accent information generated by Whisper. Through this evaluation, we aim to clarify the effect of using pitch accent information on ASR error correction in Japanese.

Zitieren

APA

Suzuki, M., Ueno, S., & Lee, A. (2025). Error correction for Japanese automatic speech recognition by large language model incorporating pitch accent information. The Journal of the Acoustical Society of America, 158(4_Supplement), A136-A136. https://doi.org/10.1121/10.0040372

Vancouver

Suzuki M, Ueno S, Lee A. Error correction for Japanese automatic speech recognition by large language model incorporating pitch accent information. The Journal of the Acoustical Society of America. 2025;158(4_Supplement):A136-A136. doi:10.1121/10.0040372

BibTeX
@article{Suzuki2025,
  author = {Suzuki, Momone and Ueno, Sei and Lee, Akinobu},
  title = {Error correction for Japanese automatic speech recognition by large language model incorporating pitch accent information},
  journal = {The Journal of the Acoustical Society of America},
  year = {2025},
  volume = {158},
  number = {4_Supplement},
  pages = {A136--A136},
  doi = {10.1121/10.0040372}
}
Kostenlos starten →