Participant Use of Artificial Intelligence in Online Focus Groups: An Experiential Account
International Journal of Qualitative Methods · 2024-01 · 23
DOI: 10.1177/16094069241286417 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Qualitative Methods, online erschienen am 15.10.2024. Verfasst von Lucy Stafford und 2 weiteren Autor:innen. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 64 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Economic and Social Research Council.
Abstract (Originalsprache)
Large language models (LLMs), one application of artificial intelligence, experienced a surge in users between 2022–2023. During this time, we were conducting online focus groups in which participants insisted on responding using the chat box feature. Based on several chat box responses, we became concerned they were LLM generated. Out of the 42 participants who typed a chat box response during a focus group, we identify 9 as potentially providing LLM generated answers and present their responses with the highest similarity score to an LLM answer. Given the growth and improvement in LLMs, we believe that this issue is likely to increase in frequency. In response to this, in this article we reflect on (1) strategies to prevent participants from using LLMs, (2) indicators LLMs may be being used, (3) the fallibility of identifying LLM generated responses, (4) philosophical frameworks that may permit LLM responses to be incorporated into analyses, and (5) procedures researchers may follow to evaluate the influence of LLM responses on their results.
Förderung
- Economic and Social Research Council
Zitieren
APA
Stafford, L., Preston, C., & Pike, A. C. (2024). Participant Use of Artificial Intelligence in Online Focus Groups: An Experiential Account. International Journal of Qualitative Methods, 23. https://doi.org/10.1177/16094069241286417
Vancouver
Stafford L, Preston C, Pike AC. Participant Use of Artificial Intelligence in Online Focus Groups: An Experiential Account. International Journal of Qualitative Methods. 2024;23. doi:10.1177/16094069241286417
BibTeX
@article{Stafford2024,
author = {Stafford, Lucy and Preston, Catherine and Pike, Alexandra C.},
title = {Participant Use of Artificial Intelligence in Online Focus Groups: An Experiential Account},
journal = {International Journal of Qualitative Methods},
year = {2024},
volume = {23},
doi = {10.1177/16094069241286417}
}
EUVIMED