EUVIMEDObjevte EUVIMED
Open access · CC BY 4.0

AI Testing for Smart Learning Applications—A Case Study

Tony Li, Quoc Thang Nguyen, Jerry Gao, Radhika Agarwal

Software · 2026-06-05 · 5 (2) · 22

DOI: 10.3390/software5020022 ↗

At a glance

Journal article in Software, published online on 2026-06-05. Written by Tony Li and 3 co-authors. 34 references. The full text is freely available (open access, CC BY 4.0).

AbstraktBibliografické údajeCiteRelated studies

Abstract (original language)

The increasing adoption of artificial intelligence (AI) in smart learning environments has heightened the need for systematic, reliable testing of AI-driven educational applications. Existing studies primarily rely on benchmark accuracy, manual testing, or user-based assessment, offering limited insight into robustness, coverage, and failure behavior. These limitations are driven by the lack of standardized intelligence quality criteria, inadequate test automation support, complex diversity in Q&A tasks, and the difficulty of automatically validating test results in smart learning applications. This paper investigates model-based AI testing for Q&A-based smart learning applications, using ChatGPT (GPT-5) as a case study to evaluate its intelligence quality in college algebra question answering tasks that support student learning. A three-dimensional (3D) AI testing framework structures testing along input, context, and output dimensions to enable model-driven test generation, controlled contextual variation, and consistent validation. College algebra problems selected from a standard undergraduate textbook are used to construct representative test cases. Controlled image-based data augmentation and structured similarity-based validation mechanisms are employed to support automated test execution and result analysis. Empirical results demonstrate that the proposed approach improves intelligence quality coverage and provides more diagnostic insight than ad hoc evaluation methods.

Cite

APA

Li, T., Nguyen, Q. T., Gao, J., & Agarwal, R. (2026). AI Testing for Smart Learning Applications—A Case Study. Software, 5(2), 22. https://doi.org/10.3390/software5020022

Vancouver

Li T, Nguyen QT, Gao J, Agarwal R. AI Testing for Smart Learning Applications—A Case Study. Software. 2026;5(2):22. doi:10.3390/software5020022

BibTeX
@article{Li2026,
  author = {Li, Tony and Nguyen, Quoc Thang and Gao, Jerry and Agarwal, Radhika},
  title = {AI Testing for Smart Learning Applications—A Case Study},
  journal = {Software},
  year = {2026},
  volume = {5},
  number = {2},
  pages = {22},
  doi = {10.3390/software5020022}
}
Start for free →