EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Evaluating the Coverage and Depth of Latent Dirichlet Allocation Topic Model in Comparison with Human Coding of Qualitative Data: The Case of Education Research

Gaurav Nanda, Aparajita Jaiswal, Hugo Castellanos, Yuzhe Zhou, Alex Choi, Alejandra J. Magana

Machine Learning and Knowledge Extraction · 14.05.2023 · 5 (2) · 473-490

DOI: 10.3390/make5020029 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Machine Learning and Knowledge Extraction, online erschienen am 14.05.2023. Verfasst von Gaurav Nanda und 5 weiteren Autor:innen. Die Arbeit wurde bisher 20-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: U.S. National Science Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Fields in the social sciences, such as education research, have started to expand the use of computer-based research methods to supplement traditional research approaches. Natural language processing techniques, such as topic modeling, may support qualitative data analysis by providing early categories that researchers may interpret and refine. This study contributes to this body of research and answers the following research questions: (RQ1) What is the relative coverage of the latent Dirichlet allocation (LDA) topic model and human coding in terms of the breadth of the topics/themes extracted from the text collection? (RQ2) What is the relative depth or level of detail among identified topics using LDA topic models and human coding approaches? A dataset of student reflections was qualitatively analyzed using LDA topic modeling and human coding approaches, and the results were compared. The findings suggest that topic models can provide reliable coverage and depth of themes present in a textual collection comparable to human coding but require manual interpretation of topics. The breadth and depth of human coding output is heavily dependent on the expertise of coders and the size of the collection; these factors are better handled in the topic modeling approach.

Förderung

  • U.S. National Science Foundation

Zitieren

APA

Nanda, G., Jaiswal, A., Castellanos, H., Zhou, Y., Choi, A., & Magana, A. J. (2023). Evaluating the Coverage and Depth of Latent Dirichlet Allocation Topic Model in Comparison with Human Coding of Qualitative Data: The Case of Education Research. Machine Learning and Knowledge Extraction, 5(2), 473-490. https://doi.org/10.3390/make5020029

Vancouver

Nanda G, Jaiswal A, Castellanos H, Zhou Y, Choi A, Magana AJ. Evaluating the Coverage and Depth of Latent Dirichlet Allocation Topic Model in Comparison with Human Coding of Qualitative Data: The Case of Education Research. Machine Learning and Knowledge Extraction. 2023;5(2):473-490. doi:10.3390/make5020029

BibTeX
@article{Nanda2023,
  author = {Nanda, Gaurav and Jaiswal, Aparajita and Castellanos, Hugo and Zhou, Yuzhe and Choi, Alex and Magana, Alejandra J.},
  title = {Evaluating the Coverage and Depth of Latent Dirichlet Allocation Topic Model in Comparison with Human Coding of Qualitative Data: The Case of Education Research},
  journal = {Machine Learning and Knowledge Extraction},
  year = {2023},
  volume = {5},
  number = {2},
  pages = {473--490},
  doi = {10.3390/make5020029}
}
Kostenlos starten →