EUVIMEDOpdag EUVIMED
Open access · CC BY-ND 4.0

AI Automatic Pronunciation Mistake Detector

Pratham Singh, Rishikesh Singh, Siddhi Sankhe, Narendra Prajapati, Manasi Churi

International Journal on Advanced Computer Theory and Engineering · 2026-05-03 · 15 (1) · 110-124

DOI: 10.65521/ijacte.v15i1.2626 ↗

At a glance

Journal article in International Journal on Advanced Computer Theory and Engineering, published online on 2026-05-03. Written by Pratham Singh and 4 co-authors. The full text is freely available (open access, CC BY-ND 4.0).

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Automated Pronunciation Evaluation plays a major role in computer-assisted learning for various languages, majorly used for learning English, and many other languages. However, effective multilingual systems for pronunciation assessment are not yet fully developed, particularly for Indic languages which have complex character and phonetic systems. Most pronunciation assessment systems utilize word-level scoring or limited acoustic models, which restrict the scope for phoneme-level assessment and accommodating linguistic diversity. Additionally, errors resulting from ASR systems affect the overall accuracy of the scoring process. This paper proposes a framework for phoneme-level pronunciation assessment system for English, Hindi, and Marathi languages. The system is developed by integrating the Whisper ASR model, word-level timestamp extraction, grapheme-to-phoneme conversion, Dynamic Time Warping for robust word alignment, and phoneme-level Levenshtein distance scoring. In addition, the schwa deletion module is included to handle Devanagari languages. The schwa deletion module is designed to eliminate the impact of schwa characters on pronunciation scores. The framework is based on a modular three-tier structure that includes a browser-based audio capture interface, a Flask-based REST API backend, and an extensible AI processing core developed based on interface-driven model abstractions. Normalization and resampling of audio signals are performed before ASR inference to improve consistency across recording conditions, while DTW-based word alignment over a word distance matrix enhances robustness against ASR variability. The experimental results show stable word alignment against recognition noise and consistent accuracy discrimination for phoneme-level qualities across varying word pronunciation qualities. Word-level categorization and IPA visualization are provided for actionable feedback on pronunciation qualities for multilingual learning scenarios.

Cite

APA

Singh, P., Singh, R., Sankhe, S., Prajapati, N., & Churi, M. (2026). AI Automatic Pronunciation Mistake Detector. International Journal on Advanced Computer Theory and Engineering, 15(1), 110-124. https://doi.org/10.65521/ijacte.v15i1.2626

Vancouver

Singh P, Singh R, Sankhe S, Prajapati N, Churi M. AI Automatic Pronunciation Mistake Detector. International Journal on Advanced Computer Theory and Engineering. 2026;15(1):110-124. doi:10.65521/ijacte.v15i1.2626

BibTeX
@article{Singh2026,
  author = {Singh, Pratham and Singh, Rishikesh and Sankhe, Siddhi and Prajapati, Narendra and Churi, Manasi},
  title = {AI Automatic Pronunciation Mistake Detector},
  journal = {International Journal on Advanced Computer Theory and Engineering},
  year = {2026},
  volume = {15},
  number = {1},
  pages = {110--124},
  doi = {10.65521/ijacte.v15i1.2626}
}
Start for free →