EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Evaluation of Inductive Coding with LLMs

Leoni Dörfel, Rieke Ammoneit

Education Sciences · 17.08.2026 · 16 (8) · 1314

DOI: 10.3390/educsci16081314 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Education Sciences, online erschienen am 17.08.2026. Verfasst von Leoni Dörfel und 1 weiteren Autor:innen. Die Arbeit nennt 67 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large Language Models (LLMs) like ChatGPT are reshaping qualitative research by offering data-driven analysis. Recent studies focus on labeling and classifying qualitative data, yet the generative process behind code system development is underexplored. This study investigates how ChatGPT constructs coding systems from interview data under iterative code engineering. The resulting code system is systematically compared to an inductive coding framework derived by content analysis—quantitatively by SBERT analysis, Jaccard index, and network analysis, and qualitatively. The results of NLP-based analysis show that there are mostly high cosine similarities in the one-to-one mapping between ChatGPT codes and content analysis. The overall Jaccard index is low, indicating limited overlap between the coding units and, consequently, that the two coding systems often did not refer to the same content. However, the mapped codes showed substantial variation: while nearly half exhibited high overlap, others showed no overlap. Network analysis shows that network density is comparable across the two systems, indicating a similar level of interconnectedness among codes despite differences in network size. Finally, iterative prompt engineering could create a stable code system, but ChatGPT lacks in domain-specific coding addressing the research questions adequately, warranting further investigation across larger datasets.

Zitieren

APA

Dörfel, L., & Ammoneit, R. (2026). Evaluation of Inductive Coding with LLMs. Education Sciences, 16(8), 1314. https://doi.org/10.3390/educsci16081314

Vancouver

Dörfel L, Ammoneit R. Evaluation of Inductive Coding with LLMs. Education Sciences. 2026;16(8):1314. doi:10.3390/educsci16081314

BibTeX
@article{Drfel2026,
  author = {Dörfel, Leoni and Ammoneit, Rieke},
  title = {Evaluation of Inductive Coding with LLMs},
  journal = {Education Sciences},
  year = {2026},
  volume = {16},
  number = {8},
  pages = {1314},
  doi = {10.3390/educsci16081314}
}
Kostenlos starten →