Assessing Human-AI Interaction Early through Factorial Surveys: A Study on the Guidelines for Human-AI Interaction
ACM Transactions on Computer-Human Interaction · 31.10.2023 · 30 (5) · 1-45
DOI: 10.1145/3511605 ↗Kurz gefasst
Leitlinie in der Zeitschrift ACM Transactions on Computer-Human Interaction, online erschienen am 23.09.2023. Verfasst von Tianyi Li und 3 weiteren Autor:innen. Die Arbeit wurde bisher 53-mal zitiert (Crossref) und nennt 120 Literaturangaben.
Abstract (Originalsprache)
This work contributes a research protocol for evaluating human-AI interaction in the context of specific AI products. The research protocol enables UX and HCI researchers to assess different human-AI interaction solutions and validate design decisions before investing in engineering. We present a detailed account of the research protocol and demonstrate its use by employing it to study an existing set of human-AI interaction guidelines. We used factorial surveys with a 2 × 2 mixed design to compare user perceptions when a guideline is applied versus violated, under conditions of optimal versus sub-optimal AI performance. The results provided both qualitative and quantitative insights into the UX impact of each guideline. These insights can support creators of user-facing AI systems in their nuanced prioritization and application of the guidelines.
Zitieren
APA
Li, T., Vorvoreanu, M., Debellis, D., & Amershi, S. (2023). Assessing Human-AI Interaction Early through Factorial Surveys: A Study on the Guidelines for Human-AI Interaction. ACM Transactions on Computer-Human Interaction, 30(5), 1-45. https://doi.org/10.1145/3511605
Vancouver
Li T, Vorvoreanu M, Debellis D, Amershi S. Assessing Human-AI Interaction Early through Factorial Surveys: A Study on the Guidelines for Human-AI Interaction. ACM Transactions on Computer-Human Interaction. 2023;30(5):1-45. doi:10.1145/3511605
BibTeX
@article{Li2023,
author = {Li, Tianyi and Vorvoreanu, Mihaela and Debellis, Derek and Amershi, Saleema},
title = {Assessing Human-AI Interaction Early through Factorial Surveys: A Study on the Guidelines for Human-AI Interaction},
journal = {ACM Transactions on Computer-Human Interaction},
year = {2023},
volume = {30},
number = {5},
pages = {1--45},
doi = {10.1145/3511605}
}
EUVIMED