EUVIMEDEUVIMED entdecken
Crossref

Automating Quality Control: A Framework for Evaluating ChatGPT‐Generated Calculus Exercises in Engineering Education

MeiMei Song, Rongbo Sa

Computer Applications in Engineering Education · 2026-09 · 34 (5)

DOI: 10.1002/cae.70264 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computer Applications in Engineering Education, online erschienen am 04.09.2026. Verfasst von MeiMei Song und 1 weiteren Autor:innen. Die Arbeit nennt 27 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The rapid adoption of ChatGPT for generating calculus exercises in engineering education faces critical quality challenges, including mathematical inaccuracies (17% symbolic errors) and pedagogical misalignment (41% dimensional inconsistencies). This study establishes an automated quality control framework featuring two innovations: (1) a five‑dimensional assessment protocol evaluating mathematical correctness (SymPy/Wolfram API), engineering relevance (PCK‑based expert scoring), cognitive alignment (Bloom taxonomy), clarity (Flesch index), and cultural safety (rule‑based filtering); (2) an open‑source toolchain MathQAValidator integrating constraint programming for prompt optimization. Analyzing 600 AI‑generated exercises, we find: (a) a 145% relative improvement in the qualification rate (the proportion of exercises meeting all five criteria) from 32% to 79% after prompt optimization; (b) critical failure patterns including 29% vector direction errors; (c) expert strictness increases by 0.38 points per teaching year. Deployed as a Chaoxing plugin, the framework provides visualized quality diagnostics for MOOC platforms. This work establishes a pedagogical‑content‑knowledge (PCK)‑informed validation paradigm for AI‑generated educational content.

Zitieren

APA

Song, M., & Sa, R. (2026). Automating Quality Control: A Framework for Evaluating ChatGPT‐Generated Calculus Exercises in Engineering Education. Computer Applications in Engineering Education, 34(5). https://doi.org/10.1002/cae.70264

Vancouver

Song M, Sa R. Automating Quality Control: A Framework for Evaluating ChatGPT‐Generated Calculus Exercises in Engineering Education. Computer Applications in Engineering Education. 2026;34(5). doi:10.1002/cae.70264

BibTeX
@article{Song2026,
  author = {Song, MeiMei and Sa, Rongbo},
  title = {Automating Quality Control: A Framework for Evaluating ChatGPT‐Generated Calculus Exercises in Engineering Education},
  journal = {Computer Applications in Engineering Education},
  year = {2026},
  volume = {34},
  number = {5},
  doi = {10.1002/cae.70264}
}
Kostenlos starten →