EUVIMEDEUVIMED entdecken
Qualitative StudieOpen Access · CC BY-NC 4.0

Validating Large Language Model–Assisted Qualitative Research: Ensuring Methodological Integrity in Engineering Education Research

Tamara Kecman, Maxwell Fingold, Susan McCahan

Proceedings of the Canadian Engineering Education Association (CEEA) · 07.08.2026

DOI: 10.24908/pceea.2026.21516 ↗

Kurz gefasst

Qualitative Studie in der Zeitschrift Proceedings of the Canadian Engineering Education Association (CEEA), online erschienen am 07.08.2026. Verfasst von Tamara Kecman und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

There are long-standing, accepted methods for validating analysis of textual data. However, there has always existed limitations on the scale of data to which human analysis can be applied. Qualitative researchers are now incorporating Large Language Models (LLMs) in their data analysis processes and beginning to standardize how LLMs can be used to reliably analyze larger sets of qualitative data, without losing the inherent reflexive nature necessary for high quality analysis. The goal of this paper is to contribute to the broader understanding of validation methods emerging for qualitative research that rely on LLMs. First, a review of the literature illustrates similarities in validation techniques LLM outputs. We then document the approach we took in our research, which explores the exposure of engineering tasks to applications of artificial intelligence. This provides a practical example of validation in a context that is different from using an LLM for qualitative coding.

Zitieren

APA

Kecman, T., Fingold, M., & McCahan, S. (2026). Validating Large Language Model–Assisted Qualitative Research: Ensuring Methodological Integrity in Engineering Education Research. Proceedings of the Canadian Engineering Education Association (CEEA). https://doi.org/10.24908/pceea.2026.21516

Vancouver

Kecman T, Fingold M, McCahan S. Validating Large Language Model–Assisted Qualitative Research: Ensuring Methodological Integrity in Engineering Education Research. Proceedings of the Canadian Engineering Education Association (CEEA). 2026. doi:10.24908/pceea.2026.21516

BibTeX
@article{Kecman2026,
  author = {Kecman, Tamara and Fingold, Maxwell and McCahan, Susan},
  title = {Validating Large Language Model–Assisted Qualitative Research: Ensuring Methodological Integrity in Engineering Education Research},
  journal = {Proceedings of the Canadian Engineering Education Association (CEEA)},
  year = {2026},
  doi = {10.24908/pceea.2026.21516}
}
Kostenlos starten →