EUVIMEDEUVIMED entdecken
Crossref

CoAIcoder: Examining the Effectiveness of AI-assisted Human-to-Human Collaboration in Qualitative Analysis

Jie Gao, Kenny Tsu Wei Choo, Junming Cao, Roy Ka-Wei Lee, Simon Perrault

ACM Transactions on Computer-Human Interaction · 29.02.2024 · 31 (1) · 1-38

DOI: 10.1145/3617362 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Computer-Human Interaction, online erschienen am 29.11.2023. Verfasst von Jie Gao und 4 weiteren Autor:innen. Die Arbeit wurde bisher 71-mal zitiert (Crossref) und nennt 72 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

While AI-assisted individual qualitative analysis has been substantially studied, AI-assisted collaborative qualitative analysis (CQA) – a process that involves multiple researchers working together to interpret data—remains relatively unexplored. After identifying CQA practices and design opportunities through formative interviews, we designed and implemented CoAIcoder, a tool leveraging AI to enhance human-to-human collaboration within CQA through four distinct collaboration methods. With a between-subject design, we evaluated CoAIcoder with 32 pairs of CQA-trained participants across common CQA phases under each collaboration method. Our findings suggest that while using a shared AI model as a mediator among coders could improve CQA efficiency and foster agreement more quickly in the early coding stage, it might affect the final code diversity. We also emphasize the need to consider the independence level when using AI to assist human-to-human collaboration in various CQA scenarios. Lastly, we suggest design implications for future AI-assisted CQA systems.

Zitieren

APA

Gao, J., Choo, K. T. W., Cao, J., Lee, R. K., & Perrault, S. (2024). CoAIcoder: Examining the Effectiveness of AI-assisted Human-to-Human Collaboration in Qualitative Analysis. ACM Transactions on Computer-Human Interaction, 31(1), 1-38. https://doi.org/10.1145/3617362

Vancouver

Gao J, Choo KTW, Cao J, Lee RK, Perrault S. CoAIcoder: Examining the Effectiveness of AI-assisted Human-to-Human Collaboration in Qualitative Analysis. ACM Transactions on Computer-Human Interaction. 2024;31(1):1-38. doi:10.1145/3617362

BibTeX
@article{Gao2024,
  author = {Gao, Jie and Choo, Kenny Tsu Wei and Cao, Junming and Lee, Roy Ka-Wei and Perrault, Simon},
  title = {CoAIcoder: Examining the Effectiveness of AI-assisted Human-to-Human Collaboration in Qualitative Analysis},
  journal = {ACM Transactions on Computer-Human Interaction},
  year = {2024},
  volume = {31},
  number = {1},
  pages = {1--38},
  doi = {10.1145/3617362}
}
Kostenlos starten →