EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Perception–Performance Gap in Generative AI: An Exploratory Study Across Two Engineering Education Contexts

Irida Shallari, Vincenzo Gallo, Marco Carratù, Mazhar Hussain, David Krapohl, Seyed Jalaleddin Mousavirad

Education Sciences · 20.05.2026 · 16 (5) · 803

DOI: 10.3390/educsci16050803 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Education Sciences, online erschienen am 20.05.2026. Verfasst von Irida Shallari und 5 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Mid Sweden University.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Generative AI (GenAI) tools are increasingly used by students in higher education, including in technically demanding engineering courses. However, fluent AI-generated responses may still contain incorrect or incomplete information, creating a risk that students overestimate their reliability. This exploratory study investigates the relationship between students’ perceived usefulness of GenAI and an instructor-benchmarked reference evaluation of model outputs in two digital systems design courses. The study involved voluntary survey responses from 32 students in an undergraduate course at MIUN and 20 students in a graduate-level course at UNISA. Student perception data were combined with teacher-side benchmarking of selected GenAI models on tasks categorized by cognitive depth. Findings indicate that prior GenAI familiarity was associated with interaction frequency and average perceived usefulness, whereas self-assessed subject knowledge showed limited association. A perception–performance gap emerged, with students often rating GenAI outputs as useful even when the instructor-side evaluation identified limitations in correctness or required substantial human scaffolding. The proposed framework should be interpreted as an exploratory guideline for studying and guiding GenAI use in engineering education, rather than as a definitive benchmark of model performance.

Förderung

  • Mid Sweden University

Zitieren

APA

Shallari, I., Gallo, V., Carratù, M., Hussain, M., Krapohl, D., & Mousavirad, S. J. (2026). Perception–Performance Gap in Generative AI: An Exploratory Study Across Two Engineering Education Contexts. Education Sciences, 16(5), 803. https://doi.org/10.3390/educsci16050803

Vancouver

Shallari I, Gallo V, Carratù M, Hussain M, Krapohl D, Mousavirad SJ. Perception–Performance Gap in Generative AI: An Exploratory Study Across Two Engineering Education Contexts. Education Sciences. 2026;16(5):803. doi:10.3390/educsci16050803

BibTeX
@article{Shallari2026,
  author = {Shallari, Irida and Gallo, Vincenzo and Carratù, Marco and Hussain, Mazhar and Krapohl, David and Mousavirad, Seyed Jalaleddin},
  title = {Perception–Performance Gap in Generative AI: An Exploratory Study Across Two Engineering Education Contexts},
  journal = {Education Sciences},
  year = {2026},
  volume = {16},
  number = {5},
  pages = {803},
  doi = {10.3390/educsci16050803}
}
Kostenlos starten →