EUVIMEDEUVIMED entdecken
Open Access · CC BY-SA 4.0

Design, Implementation, and Empirical Evaluation of a Human–AI Collaborative Adaptive Assessment Model in Higher Education

Indra Saputra, Alkadri Masnur, Resti Elma Sari, Ani Nurhayati, Elviza Yeni Putri, Melda Mahniza, Feriantano Sundang Pranata, Retno Triswandari

Journal of General Education and Humanities · 11.11.2026 · 5 (6)

DOI: 10.58421/gehu.v5i6.2254 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of General Education and Humanities, online erschienen am 11.11.2026. Verfasst von Indra Saputra und 7 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

AI-supported assessment increasingly enables adaptive tasks, automated analysis, and personalized feedback, yet their integration into coherent, human-supervised formative assessment remains insufficiently established. This study developed and evaluated the Human–AI Collaborative Adaptive Assessment Model (HA-CAAM) using Design and Development Research structured through the ADDIE framework. Implemented in a higher-education Media Education course, the model employed performance-responsive task adaptation using predefined thresholds, rubric-guided AI-assisted scoring, formative feedback, and instructor verification. Five experts validated the model, 148 students provided quantitative and qualitative implementation feedback, and 50 student responses were independently assessed by two human raters and AI. Expert validation provided initial evidence of content validity (mean Aiken's V = 0.818). Students reported generally favorable experiences, particularly regarding clarity and feedback usefulness, although Learning Support and Overall User Experience received comparatively lower ratings. AI-generated scores demonstrated strong agreement with human-reference scores (ICC = 0.898), despite individual discrepancies. These findings provide initial evidence of content validity, positive implementation experiences, and scoring agreement, rather than demonstrated improvements in learning outcomes or equivalence between AI and human assessment decisions. HA-CAAM contributes an empirically refined, seven-stage assessment framework that coordinates performance-responsive adaptation, AI-assisted analysis, formative feedback, and instructor-led quality assurance within a human-supervised assessment process.

Zitieren

APA

Saputra, I., Masnur, A., Sari, R. E., Nurhayati, A., Putri, E. Y., Mahniza, M., Pranata, F. S., & Triswandari, R. (2026). Design, Implementation, and Empirical Evaluation of a Human–AI Collaborative Adaptive Assessment Model in Higher Education. Journal of General Education and Humanities, 5(6). https://doi.org/10.58421/gehu.v5i6.2254

Vancouver

Saputra I, Masnur A, Sari RE, Nurhayati A, Putri EY, Mahniza M, et al. Design, Implementation, and Empirical Evaluation of a Human–AI Collaborative Adaptive Assessment Model in Higher Education. Journal of General Education and Humanities. 2026;5(6). doi:10.58421/gehu.v5i6.2254

BibTeX
@article{Saputra2026,
  author = {Saputra, Indra and Masnur, Alkadri and Sari, Resti Elma and Nurhayati, Ani and Putri, Elviza Yeni and Mahniza, Melda and Pranata, Feriantano Sundang and Triswandari, Retno},
  title = {Design, Implementation, and Empirical Evaluation of a Human–AI Collaborative Adaptive Assessment Model in Higher Education},
  journal = {Journal of General Education and Humanities},
  year = {2026},
  volume = {5},
  number = {6},
  doi = {10.58421/gehu.v5i6.2254}
}
Kostenlos starten →