Deception and manipulation in generative AI
Philosophical Studies · 2025-07 · 182 (7) · 1865-1887
DOI: 10.1007/s11098-024-02259-8 ↗Kurz gefasst
Fachartikel in der Zeitschrift Philosophical Studies, online erschienen am 18.01.2025. Verfasst von Christian Tarsney. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 62 Literaturangaben.
Abstract (Originalsprache)
Large language models now possess human-level linguistic abilities in many contexts. This raises the concern that they can be used to deceive and manipulate on unprecedented scales, for instance spreading political misinformation on social media. In future, agentic AI systems might also deceive and manipulate humans for their own purposes. In this paper, first, I argue that AI-generated content should be subject to stricter standards against deception and manipulation than we ordinarily apply to humans. Second, I offer new characterizations of AI deception and manipulation meant to support such standards, according to which a statement is deceptive (resp. manipulative) if it leads human addressees away from the beliefs (resp. choices) they would endorse under “semi-ideal” conditions. Third, I propose two measures to guard against AI deception and manipulation, inspired by this characterization: “extreme transparency” requirements for AI-generated content and “defensive systems” that, among other things, annotate AI-generated statements with contextualizing information. Finally, I consider to what extent these measures can protect against deceptive behavior in future, agentic AI systems.
Zitieren
APA
Tarsney, C. (2025). Deception and manipulation in generative AI. Philosophical Studies, 182(7), 1865-1887. https://doi.org/10.1007/s11098-024-02259-8
Vancouver
Tarsney C. Deception and manipulation in generative AI. Philosophical Studies. 2025;182(7):1865-1887. doi:10.1007/s11098-024-02259-8
BibTeX
@article{Tarsney2025,
author = {Tarsney, Christian},
title = {Deception and manipulation in generative AI},
journal = {Philosophical Studies},
year = {2025},
volume = {182},
number = {7},
pages = {1865--1887},
doi = {10.1007/s11098-024-02259-8}
}
EUVIMED