AI Testing for Smart Learning Applications—A Case Study
Software · 2026-06-05 · 5 (2) · 22
DOI: 10.3390/software5020022 ↗At a glance
Journal article in Software, published online on 2026-06-05. Written by Tony Li and 3 co-authors. 34 references. The full text is freely available (open access, CC BY 4.0).
Abstract (original language)
The increasing adoption of artificial intelligence (AI) in smart learning environments has heightened the need for systematic, reliable testing of AI-driven educational applications. Existing studies primarily rely on benchmark accuracy, manual testing, or user-based assessment, offering limited insight into robustness, coverage, and failure behavior. These limitations are driven by the lack of standardized intelligence quality criteria, inadequate test automation support, complex diversity in Q&A tasks, and the difficulty of automatically validating test results in smart learning applications. This paper investigates model-based AI testing for Q&A-based smart learning applications, using ChatGPT (GPT-5) as a case study to evaluate its intelligence quality in college algebra question answering tasks that support student learning. A three-dimensional (3D) AI testing framework structures testing along input, context, and output dimensions to enable model-driven test generation, controlled contextual variation, and consistent validation. College algebra problems selected from a standard undergraduate textbook are used to construct representative test cases. Controlled image-based data augmentation and structured similarity-based validation mechanisms are employed to support automated test execution and result analysis. Empirical results demonstrate that the proposed approach improves intelligence quality coverage and provides more diagnostic insight than ad hoc evaluation methods.
Cite
APA
Li, T., Nguyen, Q. T., Gao, J., & Agarwal, R. (2026). AI Testing for Smart Learning Applications—A Case Study. Software, 5(2), 22. https://doi.org/10.3390/software5020022
Vancouver
Li T, Nguyen QT, Gao J, Agarwal R. AI Testing for Smart Learning Applications—A Case Study. Software. 2026;5(2):22. doi:10.3390/software5020022
BibTeX
@article{Li2026,
author = {Li, Tony and Nguyen, Quoc Thang and Gao, Jerry and Agarwal, Radhika},
title = {AI Testing for Smart Learning Applications—A Case Study},
journal = {Software},
year = {2026},
volume = {5},
number = {2},
pages = {22},
doi = {10.3390/software5020022}
}
EUVIMED