EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Exploring new depths: Applying machine learning for the analysis of student argumentation in chemistry

Paul P. Martin, David Kranz, Peter Wulff, Nicole Graulich

Journal of Research in Science Teaching · 2024-10 · 61 (8) · 1757-1792

DOI: 10.1002/tea.21903 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Research in Science Teaching, online erschienen am 20.09.2023. Verfasst von Paul P. Martin und 3 weiteren Autor:innen. Die Arbeit wurde bisher 47-mal zitiert (Crossref) und nennt 169 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Constructing arguments is essential in science subjects like chemistry. For example, students in organic chemistry should learn to argue about the plausibility of competing chemical reactions by including various sources of evidence and justifying the derived information with reasoning. While doing so, students face significant challenges in coherently structuring their arguments and integrating chemical concepts. For this reason, a reliable assessment of students' argumentation is critical. However, as arguments are usually presented in open‐ended tasks, scoring assessments manually is resource‐consuming and conceptually difficult. To augment human diagnostic capabilities, artificial intelligence techniques such as machine learning or natural language processing offer novel possibilities for an in‐depth analysis of students' argumentation. In this study, we extensively evaluated students' written arguments about the plausibility of competing chemical reactions based on a methodological approach called computational grounded theory . By using an unsupervised clustering technique, we sought to evaluate students' argumentation patterns in detail, providing new insights into the modes of reasoning and levels of granularity applied in students' written accounts. Based on this analysis, we developed a holistic 20‐category rubric by combining the data‐driven clusters with a theory‐driven framework to automate the analysis of the identified argumentation patterns. Pre‐trained large language models in conjunction with deep neural networks provided almost perfect machine‐human score agreement and well‐interpretable results, which underpins the potential of the applied state‐of‐the‐art deep learning techniques in analyzing students' argument complexity. The findings demonstrate an approach to combining human and computer‐based analysis in uncovering written argumentation.

Zitieren

APA

Martin, P. P., Kranz, D., Wulff, P., & Graulich, N. (2024). Exploring new depths: Applying machine learning for the analysis of student argumentation in chemistry. Journal of Research in Science Teaching, 61(8), 1757-1792. https://doi.org/10.1002/tea.21903

Vancouver

Martin PP, Kranz D, Wulff P, Graulich N. Exploring new depths: Applying machine learning for the analysis of student argumentation in chemistry. Journal of Research in Science Teaching. 2024;61(8):1757-1792. doi:10.1002/tea.21903

BibTeX
@article{Martin2024,
  author = {Martin, Paul P. and Kranz, David and Wulff, Peter and Graulich, Nicole},
  title = {Exploring new depths: Applying machine learning for the analysis of student argumentation in chemistry},
  journal = {Journal of Research in Science Teaching},
  year = {2024},
  volume = {61},
  number = {8},
  pages = {1757--1792},
  doi = {10.1002/tea.21903}
}
Kostenlos starten →