The argument for near-term human disempowerment through AI
AI & SOCIETY · 2025-03 · 40 (3) · 1195-1208
DOI: 10.1007/s00146-024-01930-2 ↗Kurz gefasst
Fachartikel in der Zeitschrift AI & SOCIETY, online erschienen am 14.04.2024. Verfasst von Leonard Dung. Die Arbeit wurde bisher 28-mal zitiert (Crossref) und nennt 61 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Bundesministerium für Bildung und Forschung, Friedrich-Alexander-Universität Erlangen-Nürnberg.
Abstract (Originalsprache)
Many researchers and intellectuals warn about extreme risks from artificial intelligence. However, these warnings typically came without systematic arguments in support. This paper provides an argument that AI will lead to the permanent disempowerment of humanity, e.g. human extinction, by 2100. It rests on four substantive premises which it motivates and defends: first, the speed of advances in AI capability, as well as the capability level current systems have already reached, suggest that it is practically possible to build AI systems capable of disempowering humanity by 2100. Second, due to incentives and coordination problems, if it is possible to build such AI, it will be built. Third, since it appears to be a hard technical problem to build AI which is aligned with the goals of its designers, and many actors might build powerful AI, misaligned powerful AI will be built. Fourth, because disempowering humanity is useful for a large range of misaligned goals, such AI will try to disempower humanity. If AI is capable of disempowering humanity and tries to disempower humanity by 2100, then humanity will be disempowered by 2100. This conclusion has immense moral and prudential significance.
Förderung
- Bundesministerium für Bildung und Forschung
- Friedrich-Alexander-Universität Erlangen-Nürnberg
Zitieren
APA
Dung, L. (2025). The argument for near-term human disempowerment through AI. AI & SOCIETY, 40(3), 1195-1208. https://doi.org/10.1007/s00146-024-01930-2
Vancouver
Dung L. The argument for near-term human disempowerment through AI. AI & SOCIETY. 2025;40(3):1195-1208. doi:10.1007/s00146-024-01930-2
BibTeX
@article{Dung2025,
author = {Dung, Leonard},
title = {The argument for near-term human disempowerment through AI},
journal = {AI & SOCIETY},
year = {2025},
volume = {40},
number = {3},
pages = {1195--1208},
doi = {10.1007/s00146-024-01930-2}
}
EUVIMED