EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Verbal vs. Visual: How Humans Perceive and Collaborate with AI Teammates Using Different Communication Modalities in Various Human-AI Team Compositions

Rui Zhang, Wen Duan, Christopher Flathmann, Nathan McNeese, Bart Knijnenburg, Guo Freeman

Proceedings of the ACM on Human-Computer Interaction · 07.11.2024 · 8 (CSCW2) · 1-34

DOI: 10.1145/3686976 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the ACM on Human-Computer Interaction, online erschienen am 08.11.2024. Verfasst von Rui Zhang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 129 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

As AI becomes more advanced in natural language processing, the research on AI's communication in teaming environments is getting more attention in CSCW/HCI. Even though AI's communication serves as an essential part of facilitating team coordination and shaping team outcomes, the impact of AI's communication modality on human-AI teamwork is still understudied. Using a mixed-design experiment and follow-up group interviews with 100 participants, we investigate the impact of AI's communication modality, one of AI's most essential communication characteristics, on team coordination and team outcomes in two different human-AI team compositions, human-human-AI teams, and human-AI-AI teams. Our findings highlight the trade-offs between AI's verbal communication and visual communication, which inspire two design recommendations on how to apply AI's verbal and visual communication to support human-AI coordination effectively. Our study generates an initial understanding of the role that AI's communication will have in ensuring team effectiveness in human-AI teams in the CSCW/HCI field.

Zitieren

APA

Zhang, R., Duan, W., Flathmann, C., McNeese, N., Knijnenburg, B., & Freeman, G. (2024). Verbal vs. Visual: How Humans Perceive and Collaborate with AI Teammates Using Different Communication Modalities in Various Human-AI Team Compositions. Proceedings of the ACM on Human-Computer Interaction, 8(CSCW2), 1-34. https://doi.org/10.1145/3686976

Vancouver

Zhang R, Duan W, Flathmann C, McNeese N, Knijnenburg B, Freeman G. Verbal vs. Visual: How Humans Perceive and Collaborate with AI Teammates Using Different Communication Modalities in Various Human-AI Team Compositions. Proceedings of the ACM on Human-Computer Interaction. 2024;8(CSCW2):1-34. doi:10.1145/3686976

BibTeX
@article{Zhang2024,
  author = {Zhang, Rui and Duan, Wen and Flathmann, Christopher and McNeese, Nathan and Knijnenburg, Bart and Freeman, Guo},
  title = {Verbal vs. Visual: How Humans Perceive and Collaborate with AI Teammates Using Different Communication Modalities in Various Human-AI Team Compositions},
  journal = {Proceedings of the ACM on Human-Computer Interaction},
  year = {2024},
  volume = {8},
  number = {CSCW2},
  pages = {1--34},
  doi = {10.1145/3686976}
}
Kostenlos starten →