Automating Quality Control: A Framework for Evaluating ChatGPT‐Generated Calculus Exercises in Engineering Education
Computer Applications in Engineering Education · 2026-09 · 34 (5)
DOI: 10.1002/cae.70264 ↗Kurz gefasst
Fachartikel in der Zeitschrift Computer Applications in Engineering Education, online erschienen am 04.09.2026. Verfasst von MeiMei Song und 1 weiteren Autor:innen. Die Arbeit nennt 27 Literaturangaben.
Abstract (Originalsprache)
The rapid adoption of ChatGPT for generating calculus exercises in engineering education faces critical quality challenges, including mathematical inaccuracies (17% symbolic errors) and pedagogical misalignment (41% dimensional inconsistencies). This study establishes an automated quality control framework featuring two innovations: (1) a five‑dimensional assessment protocol evaluating mathematical correctness (SymPy/Wolfram API), engineering relevance (PCK‑based expert scoring), cognitive alignment (Bloom taxonomy), clarity (Flesch index), and cultural safety (rule‑based filtering); (2) an open‑source toolchain MathQAValidator integrating constraint programming for prompt optimization. Analyzing 600 AI‑generated exercises, we find: (a) a 145% relative improvement in the qualification rate (the proportion of exercises meeting all five criteria) from 32% to 79% after prompt optimization; (b) critical failure patterns including 29% vector direction errors; (c) expert strictness increases by 0.38 points per teaching year. Deployed as a Chaoxing plugin, the framework provides visualized quality diagnostics for MOOC platforms. This work establishes a pedagogical‑content‑knowledge (PCK)‑informed validation paradigm for AI‑generated educational content.
Zitieren
APA
Song, M., & Sa, R. (2026). Automating Quality Control: A Framework for Evaluating ChatGPT‐Generated Calculus Exercises in Engineering Education. Computer Applications in Engineering Education, 34(5). https://doi.org/10.1002/cae.70264
Vancouver
Song M, Sa R. Automating Quality Control: A Framework for Evaluating ChatGPT‐Generated Calculus Exercises in Engineering Education. Computer Applications in Engineering Education. 2026;34(5). doi:10.1002/cae.70264
BibTeX
@article{Song2026,
author = {Song, MeiMei and Sa, Rongbo},
title = {Automating Quality Control: A Framework for Evaluating ChatGPT‐Generated Calculus Exercises in Engineering Education},
journal = {Computer Applications in Engineering Education},
year = {2026},
volume = {34},
number = {5},
doi = {10.1002/cae.70264}
}
EUVIMED