AI Automatic Pronunciation Mistake Detector
International Journal on Advanced Computer Theory and Engineering · 03.05.2026 · 15 (1) · 110-124
DOI: 10.65521/ijacte.v15i1.2626 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal on Advanced Computer Theory and Engineering, online erschienen am 03.05.2026. Verfasst von Pratham Singh und 4 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-ND 4.0).
Abstract (Originalsprache)
Automated Pronunciation Evaluation plays a major role in computer-assisted learning for various languages, majorly used for learning English, and many other languages. However, effective multilingual systems for pronunciation assessment are not yet fully developed, particularly for Indic languages which have complex character and phonetic systems. Most pronunciation assessment systems utilize word-level scoring or limited acoustic models, which restrict the scope for phoneme-level assessment and accommodating linguistic diversity. Additionally, errors resulting from ASR systems affect the overall accuracy of the scoring process. This paper proposes a framework for phoneme-level pronunciation assessment system for English, Hindi, and Marathi languages. The system is developed by integrating the Whisper ASR model, word-level timestamp extraction, grapheme-to-phoneme conversion, Dynamic Time Warping for robust word alignment, and phoneme-level Levenshtein distance scoring. In addition, the schwa deletion module is included to handle Devanagari languages. The schwa deletion module is designed to eliminate the impact of schwa characters on pronunciation scores. The framework is based on a modular three-tier structure that includes a browser-based audio capture interface, a Flask-based REST API backend, and an extensible AI processing core developed based on interface-driven model abstractions. Normalization and resampling of audio signals are performed before ASR inference to improve consistency across recording conditions, while DTW-based word alignment over a word distance matrix enhances robustness against ASR variability. The experimental results show stable word alignment against recognition noise and consistent accuracy discrimination for phoneme-level qualities across varying word pronunciation qualities. Word-level categorization and IPA visualization are provided for actionable feedback on pronunciation qualities for multilingual learning scenarios.
Zitieren
APA
Singh, P., Singh, R., Sankhe, S., Prajapati, N., & Churi, M. (2026). AI Automatic Pronunciation Mistake Detector. International Journal on Advanced Computer Theory and Engineering, 15(1), 110-124. https://doi.org/10.65521/ijacte.v15i1.2626
Vancouver
Singh P, Singh R, Sankhe S, Prajapati N, Churi M. AI Automatic Pronunciation Mistake Detector. International Journal on Advanced Computer Theory and Engineering. 2026;15(1):110-124. doi:10.65521/ijacte.v15i1.2626
BibTeX
@article{Singh2026,
author = {Singh, Pratham and Singh, Rishikesh and Sankhe, Siddhi and Prajapati, Narendra and Churi, Manasi},
title = {AI Automatic Pronunciation Mistake Detector},
journal = {International Journal on Advanced Computer Theory and Engineering},
year = {2026},
volume = {15},
number = {1},
pages = {110--124},
doi = {10.65521/ijacte.v15i1.2626}
}
EUVIMED