EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

What Do I Know about AI beyond Everyday Knowledge? Unveiling Misconceptions Using Item Response Theory Analyses and Cognitive Interviews

Xingyao Xiao, Yihong Cheng

ACM Transactions on Computing Education · 31.12.2026 · 26 (4) · 1-28

DOI: 10.1145/3803805 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Computing Education, online erschienen am 19.05.2026. Verfasst von Xingyao Xiao und 1 weiteren Autor:innen. Die Arbeit nennt 66 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Advancements in AI make AI literacy essential. However, non-specialist university students often hold misunderstandings of basic AI concepts. This study used a mixed-methods approach to identify which AI concepts are most challenging for novice learners in a college population. Using the AI Concept Inventory (AI-CI) and a confirmatory multidimensional Item Response Theory (MIRT) analysis, we found that items in the AI-CI “Machine Learning (ML)” dimension (i.e., a dimension focused on general ML ideas such as learning from data and distinguishing supervised vs. unsupervised learning) were more difficult for participants than items in the other AI-CI dimensions (i.e., What is AI, Decision Trees, Supervised Learning, Generative Adversarial Networks, and Neural Networks). Cognitive interviews further suggested that everyday knowledge supported the interpretation of several AI concepts, but many ML items required more technical mental models (e.g., how training data relates to prediction and generalization). These findings highlight prevalent ML-related misconceptions among the students in our study and suggest the need for targeted instruction that explicitly addresses learning-from-data, labeling, and generalization in higher education AI literacy contexts.

Zitieren

APA

Xiao, X., & Cheng, Y. (2026). What Do I Know about AI beyond Everyday Knowledge? Unveiling Misconceptions Using Item Response Theory Analyses and Cognitive Interviews. ACM Transactions on Computing Education, 26(4), 1-28. https://doi.org/10.1145/3803805

Vancouver

Xiao X, Cheng Y. What Do I Know about AI beyond Everyday Knowledge? Unveiling Misconceptions Using Item Response Theory Analyses and Cognitive Interviews. ACM Transactions on Computing Education. 2026;26(4):1-28. doi:10.1145/3803805

BibTeX
@article{Xiao2026,
  author = {Xiao, Xingyao and Cheng, Yihong},
  title = {What Do I Know about AI beyond Everyday Knowledge? Unveiling Misconceptions Using Item Response Theory Analyses and Cognitive Interviews},
  journal = {ACM Transactions on Computing Education},
  year = {2026},
  volume = {26},
  number = {4},
  pages = {1--28},
  doi = {10.1145/3803805}
}
Kostenlos starten →