EUVIMEDEUVIMED entdecken
Leitlinie

Assessing Human-AI Interaction Early through Factorial Surveys: A Study on the Guidelines for Human-AI Interaction

Tianyi Li, Mihaela Vorvoreanu, Derek Debellis, Saleema Amershi

ACM Transactions on Computer-Human Interaction · 31.10.2023 · 30 (5) · 1-45

DOI: 10.1145/3511605 ↗

Kurz gefasst

Leitlinie in der Zeitschrift ACM Transactions on Computer-Human Interaction, online erschienen am 23.09.2023. Verfasst von Tianyi Li und 3 weiteren Autor:innen. Die Arbeit wurde bisher 53-mal zitiert (Crossref) und nennt 120 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This work contributes a research protocol for evaluating human-AI interaction in the context of specific AI products. The research protocol enables UX and HCI researchers to assess different human-AI interaction solutions and validate design decisions before investing in engineering. We present a detailed account of the research protocol and demonstrate its use by employing it to study an existing set of human-AI interaction guidelines. We used factorial surveys with a 2 × 2 mixed design to compare user perceptions when a guideline is applied versus violated, under conditions of optimal versus sub-optimal AI performance. The results provided both qualitative and quantitative insights into the UX impact of each guideline. These insights can support creators of user-facing AI systems in their nuanced prioritization and application of the guidelines.

Zitieren

APA

Li, T., Vorvoreanu, M., Debellis, D., & Amershi, S. (2023). Assessing Human-AI Interaction Early through Factorial Surveys: A Study on the Guidelines for Human-AI Interaction. ACM Transactions on Computer-Human Interaction, 30(5), 1-45. https://doi.org/10.1145/3511605

Vancouver

Li T, Vorvoreanu M, Debellis D, Amershi S. Assessing Human-AI Interaction Early through Factorial Surveys: A Study on the Guidelines for Human-AI Interaction. ACM Transactions on Computer-Human Interaction. 2023;30(5):1-45. doi:10.1145/3511605

BibTeX
@article{Li2023,
  author = {Li, Tianyi and Vorvoreanu, Mihaela and Debellis, Derek and Amershi, Saleema},
  title = {Assessing Human-AI Interaction Early through Factorial Surveys: A Study on the Guidelines for Human-AI Interaction},
  journal = {ACM Transactions on Computer-Human Interaction},
  year = {2023},
  volume = {30},
  number = {5},
  pages = {1--45},
  doi = {10.1145/3511605}
}
Kostenlos starten →