TOWARDS EFFECTIVE ARGUMENTATION: DESIGN AND IMPLEMENTATION OF A GENERATIVE AI-BASED EVALUATION AND FEEDBACK SYSTEM
Journal of Baltic Science Education · 20.04.2024 · 23 (2) · 280-291
DOI: 10.33225/jbse/24.23.280 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Baltic Science Education, online erschienen am 21.04.2024. Verfasst von Hunkoog Jho und 1 weiteren Autor:innen. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 30 Literaturangaben.
Abstract (Originalsprache)
This study aimed at examining the performance of generative artificial intelligence to extract argumentation elements from text. Thus, the researchers developed a web-based framework to provide automated assessment and feedback relying on a large language model, ChatGPT. The results produced by ChatGPT were compared to human experts across scientific and non-scientific contexts. The findings revealed marked discrepancies in the performance of AI for extracting argument components, with a significant variance between issues of a scientific nature and those that are not. Higher accuracy was noted in identifying claims, data, and qualifiers, as opposed to rebuttals, backing, and warrants. The study illuminated AI's promise for educational applications but also its shortcomings, such as the increased frequency of erroneous element identification when accuracy was low. This highlights the essential need for more in-depth comparative research on models and the further development of AI to enhance its role in supporting argumentation training. Keywords: argumentative writing, artificial intelligence, automated assessment, natural language processing, web architecture
Zitieren
APA
Jho, H., & Ha, M. (2024). TOWARDS EFFECTIVE ARGUMENTATION: DESIGN AND IMPLEMENTATION OF A GENERATIVE AI-BASED EVALUATION AND FEEDBACK SYSTEM. Journal of Baltic Science Education, 23(2), 280-291. https://doi.org/10.33225/jbse/24.23.280
Vancouver
Jho H, Ha M. TOWARDS EFFECTIVE ARGUMENTATION: DESIGN AND IMPLEMENTATION OF A GENERATIVE AI-BASED EVALUATION AND FEEDBACK SYSTEM. Journal of Baltic Science Education. 2024;23(2):280-291. doi:10.33225/jbse/24.23.280
BibTeX
@article{Jho2024,
author = {Jho, Hunkoog and Ha, Minsu},
title = {TOWARDS EFFECTIVE ARGUMENTATION: DESIGN AND IMPLEMENTATION OF A GENERATIVE AI-BASED EVALUATION AND FEEDBACK SYSTEM},
journal = {Journal of Baltic Science Education},
year = {2024},
volume = {23},
number = {2},
pages = {280--291},
doi = {10.33225/jbse/24.23.280}
}
EUVIMED