EUVIMEDEUVIMED entdecken
Crossref

Evaluating ChatGPT for Grading Programming Assignments: Effectiveness, Fairness, and Student Perceptions

Abedallah Zaid Abualkishik, Sherzod Turaev, Ali A. Alwan, Mohamed Elhoseny, Mohsin Murtaza

International Journal of Advanced Computer Science and Applications · 2026 · 17 (3)

DOI: 10.14569/ijacsa.2026.0170328 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Advanced Computer Science and Applications, 2026. Verfasst von Abedallah Zaid Abualkishik und 4 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study investigates ChatGPT as an automated grading tool for programming assignments in higher education. Three datasets comprising Python, C++, and Java assignments were graded three times by ChatGPT and compared with faculty evaluations. Results show that ChatGPT achieves high grading accuracy, closely aligning with faculty scores and demonstrating statistically significant correlations. Statistical analyses using the Kolmogorov–Smirnov test, paired t-test, and Wilcoxon signed-rank test confirm overall agreement, although ChatGPT tends to apply stricter grading criteria. High intraclass correlation coefficients further indicate strong reliability and consistency across repeated grading attempts. The study highlights the critical role of well-defined rubrics in improving grading alignment and proposes an Instructor–AI Collaborative Rubric Development framework to support effective AI integration in assessment. A survey of 158 students indicates increased satisfaction and trust following disclosure of AI-assisted grading, although some still prefer human evaluation. Overall, the findings provide strong evidence that ChatGPT is a reliable and consistent grading tool, demonstrating close alignment with faculty evaluations and high reproducibility across attempts. However, its effectiveness is critically dependent on well-defined rubrics and requires human oversight to mitigate strictness, ensure fairness, and account for contextual nuances. These results strongly support a hybrid AI–human grading approach, grounded in transparent rubric design and reinforced by appropriate ethical safeguards.

Zitieren

APA

Abualkishik, A. Z., Turaev, S., Alwan, A. A., Elhoseny, M., & Murtaza, M. (2026). Evaluating ChatGPT for Grading Programming Assignments: Effectiveness, Fairness, and Student Perceptions. International Journal of Advanced Computer Science and Applications, 17(3). https://doi.org/10.14569/ijacsa.2026.0170328

Vancouver

Abualkishik AZ, Turaev S, Alwan AA, Elhoseny M, Murtaza M. Evaluating ChatGPT for Grading Programming Assignments: Effectiveness, Fairness, and Student Perceptions. International Journal of Advanced Computer Science and Applications. 2026;17(3). doi:10.14569/ijacsa.2026.0170328

BibTeX
@article{Abualkishik2026,
  author = {Abualkishik, Abedallah Zaid and Turaev, Sherzod and Alwan, Ali A. and Elhoseny, Mohamed and Murtaza, Mohsin},
  title = {Evaluating ChatGPT for Grading Programming Assignments: Effectiveness, Fairness, and Student Perceptions},
  journal = {International Journal of Advanced Computer Science and Applications},
  year = {2026},
  volume = {17},
  number = {3},
  doi = {10.14569/ijacsa.2026.0170328}
}
Kostenlos starten →