Measuring students' AI competence: Development and validation of a multidimensional scale integrating educational psychology perspectives
Acta Psychologica · 2025-09 · 259 · 105446
DOI: 10.1016/j.actpsy.2025.105446 ↗Kurz gefasst
Validierungsstudie in der Zeitschrift Acta Psychologica, 2025-09. Verfasst von Zubair Ahmad und 5 weiteren Autor:innen. Beteiligte Einrichtung: Qatar University Young Scientists Center (QUYSC), Qatar University, 2713, Doha, Qatar. Electronic address: zubairtarar@qu.edu.qa. Hauptthemen laut MEDLINE: Students, Artificial Intelligence, Psychology, Educational, Psychometrics. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 60 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Qatar Research, Development and Innovation Council, Qatar National Research Fund.
Abstract (Originalsprache)
The rapid integration of Artificial Intelligence (AI) into K-12 education has created a pressing need to evaluate students' capacity to engage with AI effectively and responsibly. As outlined in UNESCO's AI Competency Framework, AI competence is a multidimensional construct encompassing cognitive (knowledge and skills), affective (values and motivation), ethical (principles and responsibilities), and technical (practical and design-based) dimensions. Without systematic assessment, educators lack the evidence needed to ensure students possess not only technical proficiency but also the critical thinking, ethical awareness, and motivation required in AI-driven learning environments. To address this gap, the present study develops and validates the AI Competence Scale (AICS), a multidimensional instrument grounded in UNESCO's framework and educational psychology principles. The AICS conceptualizes AI competence across four interrelated dimensions-Human-Centred Mindset, Ethics of AI, AI Techniques and Applications, and AI System Design-capturing the interplay between students' knowledge, values, reasoning, and applied skills. Data were collected from 608 high school students in public secondary schools in Qatar, following a multi-stage process: expert reviews for content validity; exploratory and confirmatory factor analyses for construct validity; reliability testing via Cronbach's alpha and composite reliability; and convergent, discriminant, and nomological validity using AVE, HTMT ratios, and structural equation modeling (SEM). The results confirmed strong psychometric properties, with SEM revealing a significant positive association between AI competence and students' interest in AI-related careers. The validated AICS provides educators, researchers, and policymakers with a theoretically grounded and empirically robust tool for assessing students' readiness for ethical and informed engagement with AI, supporting curriculum design, targeted interventions, and evidence-based policy in K-12 AI education.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Qatar University Young Scientists Center (QUYSC), Qatar University, 2713, Doha, Qatar. Electronic address: zubairtarar@qu.edu.qa.
- Qatar University Young Scientists Center (QUYSC), Qatar University, 2713, Doha, Qatar.
- Educational Research Center, College of Education, Qatar University, 2713, Doha, Qatar.
- Department of Mathematics, Statistics and Physics, Qatar University, 2713, Doha, Qatar.
Förderung
- Qatar Research, Development and Innovation Council
- Qatar National Research Fund
Zitieren
APA
Ahmad, Z., Sultana, A., Latheef, N. A., Siby, N., Sellami, A., & Abbasi, S. A. (2025). Measuring students' AI competence: Development and validation of a multidimensional scale integrating educational psychology perspectives. Acta Psychologica, 259, 105446. https://doi.org/10.1016/j.actpsy.2025.105446
Vancouver
Ahmad Z, Sultana A, Latheef NA, Siby N, Sellami A, Abbasi SA. Measuring students' AI competence: Development and validation of a multidimensional scale integrating educational psychology perspectives. Acta Psychologica. 2025;259:105446. doi:10.1016/j.actpsy.2025.105446
BibTeX
@article{Ahmad2025,
author = {Ahmad, Zubair and Sultana, Almaas and Latheef, Nafilah Abdul and Siby, Nitha and Sellami, Abdellatif and Abbasi, Saddam Akber},
title = {Measuring students' AI competence: Development and validation of a multidimensional scale integrating educational psychology perspectives},
journal = {Acta Psychologica},
year = {2025},
volume = {259},
pages = {105446},
doi = {10.1016/j.actpsy.2025.105446}
}
EUVIMED