Towards Human-Centered Explainable AI: A Survey of User Studies for Model Explanations
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2024-04 · 46 (4) · 2104-2122
DOI: 10.1109/tpami.2023.3331846 ↗Kurz gefasst
Systematische Übersicht in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024-04. Verfasst von Yao Rong und 8 weiteren Autor:innen. Hauptthemen laut MEDLINE: Algorithms. Die Arbeit wurde bisher 291-mal zitiert (Crossref) und nennt 199 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Explainable AI (XAI) is widely viewed as a sine qua non for ever-expanding AI research. A better understanding of the needs of XAI users, as well as human-centered evaluations of explainable models are both a necessity and a challenge. In this paper, we explore how human-computer interaction (HCI) and AI researchers conduct user studies in XAI applications based on a systematic literature review. After identifying and thoroughly analyzing 97 core papers with human-based XAI evaluations over the past five years, we categorize them along the measured characteristics of explanatory methods, namely trust, understanding, usability, and human-AI collaboration performance. Our research shows that XAI is spreading more rapidly in certain application domains, such as recommender systems than in others, but that user evaluations are still rather sparse and incorporate hardly any insights from cognitive or social sciences. Based on a comprehensive discussion of best practices, i.e., common models, design choices, and measures in user studies, we propose practical guidelines on designing and conducting user studies for XAI researchers and practitioners. Lastly, this survey also highlights several open research directions, particularly linking psychological science and human-centered XAI.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Zitieren
APA
Rong, Y., Leemann, T., Nguyen, T. T., Fiedler, L., Qian, P., Unhelkar, V., Seidel, T., Kasneci, G., & Kasneci, E. (2024). Towards Human-Centered Explainable AI: A Survey of User Studies for Model Explanations. IEEE Transactions on Pattern Analysis and Machine Intelligence, 46(4), 2104-2122. https://doi.org/10.1109/tpami.2023.3331846
Vancouver
Rong Y, Leemann T, Nguyen TT, Fiedler L, Qian P, Unhelkar V, et al. Towards Human-Centered Explainable AI: A Survey of User Studies for Model Explanations. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2024;46(4):2104-2122. doi:10.1109/tpami.2023.3331846
BibTeX
@article{Rong2024,
author = {Rong, Yao and Leemann, Tobias and Nguyen, Thai-Trang and Fiedler, Lisa and Qian, Peizhu and Unhelkar, Vaibhav and Seidel, Tina and Kasneci, Gjergji and Kasneci, Enkelejda},
title = {Towards Human-Centered Explainable AI: A Survey of User Studies for Model Explanations},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2024},
volume = {46},
number = {4},
pages = {2104--2122},
doi = {10.1109/tpami.2023.3331846}
}
EUVIMED