EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

An AIoT-Based Framework for Automated English-Speaking Assessment: Architecture, Benchmarking, and Reliability Analysis of Open-Source ASR

Paniti Netinant, Rerkchai Fooprateepsiri, Ajjima Rukhiran, Meennapa Rukhiran

Informatics · 26.01.2026 · 13 (2) · 19

DOI: 10.3390/informatics13020019 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Informatics, online erschienen am 26.01.2026. Verfasst von Paniti Netinant und 3 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 80 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The emergence of low-cost edge devices has enabled the integration of automatic speech recognition (ASR) into IoT environments, creating new opportunities for real-time language assessment. However, achieving reliable performance on resource-constrained hardware remains a significant challenge, especially on the Artificial Internet of Things (AIoT). This study presents an AIoT-based framework for automated English-speaking assessment that integrates architecture and system design, ASR benchmarking, and reliability analysis on edge devices. The proposed AIoT-oriented architecture incorporates a lightweight scoring framework capable of analyzing pronunciation, fluency, prosody, and CEFR-aligned speaking proficiency within an automated assessment system. Seven open-source ASR models—four Whisper variants (tiny, base, small, and medium) and three Vosk models—were systematically benchmarked in terms of recognition accuracy, inference latency, and computational efficiency. Experimental results indicate that Whisper-medium deployed on the Raspberry Pi 5 achieved the strongest overall performance, reducing inference latency by 42–48% compared with the Raspberry Pi 4 and attaining the lowest Word Error Rate (WER) of 6.8%. In contrast, smaller models such as Whisper-tiny, with a WER of 26.7%, exhibited two- to threefold higher scoring variability, demonstrating how recognition errors propagate into automated assessment reliability. System-level testing revealed that the Raspberry Pi 5 can sustain near real-time processing with approximately 58% CPU utilization and around 1.2 GB of memory, whereas the Raspberry Pi 4 frequently approaches practical operational limits under comparable workloads. Validation using real learner speech data (approximately 100 sessions) confirmed that the proposed system delivers accurate, portable, and privacy-preserving speaking assessment using low-power edge hardware. Overall, this work introduces a practical AIoT-based assessment framework, provides a comprehensive benchmark of open-source ASR models on edge platforms, and offers empirical insights into the trade-offs among recognition accuracy, inference latency, and scoring stability in edge-based ASR deployments.

Zitieren

APA

Netinant, P., Fooprateepsiri, R., Rukhiran, A., & Rukhiran, M. (2026). An AIoT-Based Framework for Automated English-Speaking Assessment: Architecture, Benchmarking, and Reliability Analysis of Open-Source ASR. Informatics, 13(2), 19. https://doi.org/10.3390/informatics13020019

Vancouver

Netinant P, Fooprateepsiri R, Rukhiran A, Rukhiran M. An AIoT-Based Framework for Automated English-Speaking Assessment: Architecture, Benchmarking, and Reliability Analysis of Open-Source ASR. Informatics. 2026;13(2):19. doi:10.3390/informatics13020019

BibTeX
@article{Netinant2026,
  author = {Netinant, Paniti and Fooprateepsiri, Rerkchai and Rukhiran, Ajjima and Rukhiran, Meennapa},
  title = {An AIoT-Based Framework for Automated English-Speaking Assessment: Architecture, Benchmarking, and Reliability Analysis of Open-Source ASR},
  journal = {Informatics},
  year = {2026},
  volume = {13},
  number = {2},
  pages = {19},
  doi = {10.3390/informatics13020019}
}
Kostenlos starten →