Faulty Tools or Disruptive Teammates? A New Theory of Human-AI Conflict and Compromise
Theoretical and Applied Ergonomics · 20.07.2026 · 2 (3) · 14
DOI: 10.3390/tae2030014 ↗Kurz gefasst
Fachartikel in der Zeitschrift Theoretical and Applied Ergonomics, online erschienen am 20.07.2026. Verfasst von Gerald Matthews und 5 weiteren Autor:innen. Die Arbeit nennt 169 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Air Force Office of Scientific Research.
Abstract (Originalsprache)
Advances in AI are increasing the scope for “reasonable disagreements” between humans and artificial systems. Intelligent robots and virtual agents are increasingly tasked with complex, potentially open-ended assignments that require the AI to function autonomously. AI judgments and decisions can lack transparency and explainability, leading to conflict with the human operator or user, requiring compromise to resolve the conflict. This article presents a new theory of human-AI conflict and compromise, drawing on research on decision-making, conflict in human teams, trust in human-robot teaming, and the challenges for humans of interacting with AI. It is proposed that the nature of conflict depends on the human’s mental model of AI functioning. If the human sees the AI as an advanced tool, conflict arises from differences in choice and implementation of algorithms for joint decision-making. Research on multi-cue judgment within the framework of the Brunswik Lens Model illustrates this type of conflict and its resolution. By contrast, if the mental model attributes humanlike characteristics to the AI, including a Theory of Mind, conflict can arise from different person-centered narratives for framing the task or team functioning. When narratives clash, the robot may be perceived as unsupportive or in violation of team role expectancies. In this case, system design may require using AI natural language capabilities and dialogue can facilitate compromise through context-sensitive matching of the human’s mental model to robot functionality.
Förderung
- Air Force Office of Scientific Research
Zitieren
APA
Matthews, G., Cumings, R., Lin, J., Mouloua, M., Chella, A., & Pipitone, A. (2026). Faulty Tools or Disruptive Teammates? A New Theory of Human-AI Conflict and Compromise. Theoretical and Applied Ergonomics, 2(3), 14. https://doi.org/10.3390/tae2030014
Vancouver
Matthews G, Cumings R, Lin J, Mouloua M, Chella A, Pipitone A. Faulty Tools or Disruptive Teammates? A New Theory of Human-AI Conflict and Compromise. Theoretical and Applied Ergonomics. 2026;2(3):14. doi:10.3390/tae2030014
BibTeX
@article{Matthews2026,
author = {Matthews, Gerald and Cumings, Ryon and Lin, Jinchao and Mouloua, Mustapha and Chella, Antonio and Pipitone, Arianna},
title = {Faulty Tools or Disruptive Teammates? A New Theory of Human-AI Conflict and Compromise},
journal = {Theoretical and Applied Ergonomics},
year = {2026},
volume = {2},
number = {3},
pages = {14},
doi = {10.3390/tae2030014}
}
EUVIMED