Error correction for Japanese automatic speech recognition by large language model incorporating pitch accent information
The Journal of the Acoustical Society of America · 01.10.2025 · 158 (4_Supplement) · A136-A136
DOI: 10.1121/10.0040372 ↗Kurz gefasst
Fachartikel in der Zeitschrift The Journal of the Acoustical Society of America, erschienen am 01.10.2025. Verfasst von Momone Suzuki und 2 weiteren Autor:innen.
Abstract (Originalsprache)
Recent studies have shown the effectiveness of large language models (LLMs) in error correction for automatic speech recognition (ASR). However, existing LLM based error correction approaches use only textual information and neglect pitch accent information, which leads to over-correction. In Japanese language, there are the words, such as “Hashi (Chopsticks)” and “Hashi (Bridge),” that can be distinguished by the difference of the pitch accent and the pitch accent information is important for error correction in Japanese ASR. In this paper, we investigate the use of pre-trained LLM to improve the outputs of Japanese ASR. In particular, we aim to improve error correction by using the N-best hypotheses and pitch accent information generated by ASR as input to LLM. We fine-tune the LLM and design an input prompt to the LLM by combining the N-best hypotheses and the corresponding pitch accent information generated by Whisper. Through this evaluation, we aim to clarify the effect of using pitch accent information on ASR error correction in Japanese.
Zitieren
APA
Suzuki, M., Ueno, S., & Lee, A. (2025). Error correction for Japanese automatic speech recognition by large language model incorporating pitch accent information. The Journal of the Acoustical Society of America, 158(4_Supplement), A136-A136. https://doi.org/10.1121/10.0040372
Vancouver
Suzuki M, Ueno S, Lee A. Error correction for Japanese automatic speech recognition by large language model incorporating pitch accent information. The Journal of the Acoustical Society of America. 2025;158(4_Supplement):A136-A136. doi:10.1121/10.0040372
BibTeX
@article{Suzuki2025,
author = {Suzuki, Momone and Ueno, Sei and Lee, Akinobu},
title = {Error correction for Japanese automatic speech recognition by large language model incorporating pitch accent information},
journal = {The Journal of the Acoustical Society of America},
year = {2025},
volume = {158},
number = {4_Supplement},
pages = {A136--A136},
doi = {10.1121/10.0040372}
}
EUVIMED