EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Evaluating the evaluators: a comparative study of AI and Teacher Assessments in Higher Education

Tugra Karademir coskun, Ayfer Alper

Digital Education Review · 01.07.2024 · (45) · 124-140

DOI: 10.1344/der.2024.45.124-140 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Digital Education Review, online erschienen am 01.07.2024. Verfasst von Tugra Karademir coskun und 1 weiteren Autor:innen. Die Arbeit wurde bisher 30-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study aims to examine the potential differences between teacher evaluations and artificial intelligence (AI) tool-based assessment systems in university examinations. The research has evaluated a wide spectrum of exams including numerical and verbal course exams, exams with different assessment styles (project, test exam, traditional exam), and both theoretical and practical course exams. These exams were selected using a criterion sampling method and were analyzed using Bland-Altman Analysis and Intraclass Correlation Coefficient (ICC) analyses to assess how AI and teacher evaluations performed across a broad range. The research findings indicate that while there is a high level of proficiency between the total exam scores assessed by artificial intelligence and teacher evaluations; medium consistency was found in the evaluation of visually-based exams, low consistency in video exams, high consistency in test exams, and low consistency in traditional exams. This research is crucial as it helps to identify specific areas where artificial intelligence can either complement or needs improvement in educational assessment, guiding the development of more accurate and fair evaluation tools.

Zitieren

APA

coskun, T. K., & Alper, A. (2024). Evaluating the evaluators: a comparative study of AI and Teacher Assessments in Higher Education. Digital Education Review, 124-140. https://doi.org/10.1344/der.2024.45.124-140

Vancouver

coskun TK, Alper A. Evaluating the evaluators: a comparative study of AI and Teacher Assessments in Higher Education. Digital Education Review. 2024:124-140. doi:10.1344/der.2024.45.124-140

BibTeX
@article{coskun2024,
  author = {coskun, Tugra Karademir and Alper, Ayfer},
  title = {Evaluating the evaluators: a comparative study of AI and Teacher Assessments in Higher Education},
  journal = {Digital Education Review},
  year = {2024},
  number = {45},
  pages = {124--140},
  doi = {10.1344/der.2024.45.124-140}
}
Kostenlos starten →