Perception–Performance Gap in Generative AI: An Exploratory Study Across Two Engineering Education Contexts
Education Sciences · 20.05.2026 · 16 (5) · 803
DOI: 10.3390/educsci16050803 ↗Kurz gefasst
Fachartikel in der Zeitschrift Education Sciences, online erschienen am 20.05.2026. Verfasst von Irida Shallari und 5 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Mid Sweden University.
Abstract (Originalsprache)
Generative AI (GenAI) tools are increasingly used by students in higher education, including in technically demanding engineering courses. However, fluent AI-generated responses may still contain incorrect or incomplete information, creating a risk that students overestimate their reliability. This exploratory study investigates the relationship between students’ perceived usefulness of GenAI and an instructor-benchmarked reference evaluation of model outputs in two digital systems design courses. The study involved voluntary survey responses from 32 students in an undergraduate course at MIUN and 20 students in a graduate-level course at UNISA. Student perception data were combined with teacher-side benchmarking of selected GenAI models on tasks categorized by cognitive depth. Findings indicate that prior GenAI familiarity was associated with interaction frequency and average perceived usefulness, whereas self-assessed subject knowledge showed limited association. A perception–performance gap emerged, with students often rating GenAI outputs as useful even when the instructor-side evaluation identified limitations in correctness or required substantial human scaffolding. The proposed framework should be interpreted as an exploratory guideline for studying and guiding GenAI use in engineering education, rather than as a definitive benchmark of model performance.
Förderung
- Mid Sweden University
Zitieren
APA
Shallari, I., Gallo, V., Carratù, M., Hussain, M., Krapohl, D., & Mousavirad, S. J. (2026). Perception–Performance Gap in Generative AI: An Exploratory Study Across Two Engineering Education Contexts. Education Sciences, 16(5), 803. https://doi.org/10.3390/educsci16050803
Vancouver
Shallari I, Gallo V, Carratù M, Hussain M, Krapohl D, Mousavirad SJ. Perception–Performance Gap in Generative AI: An Exploratory Study Across Two Engineering Education Contexts. Education Sciences. 2026;16(5):803. doi:10.3390/educsci16050803
BibTeX
@article{Shallari2026,
author = {Shallari, Irida and Gallo, Vincenzo and Carratù, Marco and Hussain, Mazhar and Krapohl, David and Mousavirad, Seyed Jalaleddin},
title = {Perception–Performance Gap in Generative AI: An Exploratory Study Across Two Engineering Education Contexts},
journal = {Education Sciences},
year = {2026},
volume = {16},
number = {5},
pages = {803},
doi = {10.3390/educsci16050803}
}
EUVIMED