EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Generative artificial intelligence in qualitative analysis: a critical examination of tools, trust and rigor

Joaquim Jose Carvalho Proença, Carmen Ramos Vera

Prometheus · 2026 · 41 (1)

DOI: 10.13169/prometheus.41.1.0004 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Prometheus, 2026. Verfasst von Joaquim Jose Carvalho Proença und 1 weiteren Autor:innen. Die Arbeit nennt 24 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study addresses a critical gap in existing research by systematically comparing the performance of five popular large language models (LLMs) in supporting high-quality qualitative research. Our methodology combines a literature review of academic papers from 2020 to 2025 with a proof-of-concept experiment evaluating ScholarAI, ChatGPT-4o, Claude 3.5 Sonnet, NotebookLM and Perplexity on key qualitative analysis tasks. We sought to determine how well these generative artificial intelligence (AI) models meet established standards of methodological rigor in qualitative analysis. Findings reveal significant variation in LLM performance: the models excelled at efficiently retrieving relevant literature, summarizing content and generating insights, but exhibited inconsistencies in contextual comprehension, coding accuracy and depth of critical analysis. These results informed a novel evaluation framework aligning LLM outputs with qualitative research quality criteria, contributing guidance for researchers and practitioners. We recommend that practitioners leverage LLMs to improve productivity while exercising critical oversight of their outputs, and that researchers address ethical concerns and refine evaluation rubrics to ensure responsible AI integration. Overall, this work establishes a foundation for responsible human–AI collaboration in qualitative research by highlighting both the opportunities and challenges of using generative AI to enhance methodological rigor and accessibility.

Zitieren

APA

Proença, J. J. C., & Vera, C. R. (2026). Generative artificial intelligence in qualitative analysis: a critical examination of tools, trust and rigor. Prometheus, 41(1). https://doi.org/10.13169/prometheus.41.1.0004

Vancouver

Proença JJC, Vera CR. Generative artificial intelligence in qualitative analysis: a critical examination of tools, trust and rigor. Prometheus. 2026;41(1). doi:10.13169/prometheus.41.1.0004

BibTeX
@article{Proena2026,
  author = {Proença, Joaquim Jose Carvalho and Vera, Carmen Ramos},
  title = {Generative artificial intelligence in qualitative analysis: a critical examination of tools, trust and rigor},
  journal = {Prometheus},
  year = {2026},
  volume = {41},
  number = {1},
  doi = {10.13169/prometheus.41.1.0004}
}
Kostenlos starten →