EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Trust Me, I’m AI: A User-Centric Review of Human–Machine Interaction and Teaming With Explainable AI

Doreen Jirak, Pieter Maes, Dirk van Rooy

IEEE Access · 2026 · 14 · 59580-59606

DOI: 10.1109/access.2026.3682940 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Access, 2026. Verfasst von Doreen Jirak und 2 weiteren Autor:innen. Die Arbeit nennt 174 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Defence-Related Research Action (DEFRA) Adaptive Human-Operator Interaction with Autonomous Systems (AHOI) Project funded by the Belgian Royal Higher Institute….

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

As artificial intelligence (AI) systems increasingly permeate real-world decision-making scenarios, the demand for user-centered Explainable AI (XAI) becomes critical. This systematic review investigates the interdisciplinary landscape of user studies in XAI, focusing on the interplay between explanation design, trust formation, cognitive load, and human-AI teaming. Drawing from literature across machine learning, psychology, and human factors research, we analyze 31 empirical studies according to three guiding questions: 1) how XAI design affects user acceptance and understanding; 2) which psychological and cognitive factors influence trust development; and 3) how AI explainability impacts teamwork, decision quality, and situational awareness in collaborative human-AI settings. We provide a critical synthesis of experimental designs, participant demographics, evaluation metrics, and replicability standards, revealing common methodological shortcomings such as age and gender imbalances, over-reliance on student samples, and inconsistent reporting practices. Based on our findings, we propose the “Design–Trust–Teaming” (DTT) framework to guide future research and evaluation of user-centered XAI systems. This review offers actionable insights for designing adaptive, inclusive, and trustworthy AI systems that facilitate meaningful collaboration between humans and intelligent agents.

Förderung

  • Defence-Related Research Action (DEFRA) Adaptive Human-Operator Interaction with Autonomous Systems (AHOI) Project funded by the Belgian Royal Higher Institute…

Zitieren

APA

Jirak, D., Maes, P., & Rooy, D. V. (2026). Trust Me, I’m AI: A User-Centric Review of Human–Machine Interaction and Teaming With Explainable AI. IEEE Access, 14, 59580-59606. https://doi.org/10.1109/access.2026.3682940

Vancouver

Jirak D, Maes P, Rooy DV. Trust Me, I’m AI: A User-Centric Review of Human–Machine Interaction and Teaming With Explainable AI. IEEE Access. 2026;14:59580-59606. doi:10.1109/access.2026.3682940

BibTeX
@article{Jirak2026,
  author = {Jirak, Doreen and Maes, Pieter and Rooy, Dirk van},
  title = {Trust Me, I’m AI: A User-Centric Review of Human–Machine Interaction and Teaming With Explainable AI},
  journal = {IEEE Access},
  year = {2026},
  volume = {14},
  pages = {59580--59606},
  doi = {10.1109/access.2026.3682940}
}
Kostenlos starten →