The political preferences of LLMs
PLOS ONE · 31.07.2024 · 19 (7) · e0306621
DOI: 10.1371/journal.pone.0306621 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS ONE, online erschienen am 31.07.2024. Verfasst von David Rozado. Beteiligte Einrichtung: ECL, Otago Polytechnic, Dunedin, New Zealand. Hauptthemen laut MEDLINE: Politics. Die Arbeit wurde bisher 83-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Institute for Cultural Evolution.
Abstract (Originalsprache)
I report here a comprehensive analysis about the political preferences embedded in Large Language Models (LLMs). Namely, I administer 11 political orientation tests, designed to identify the political preferences of the test taker, to 24 state-of-the-art conversational LLMs, both closed and open source. When probed with questions/statements with political connotations, most conversational LLMs tend to generate responses that are diagnosed by most political test instruments as manifesting preferences for left-of-center viewpoints. This does not appear to be the case for five additional base (i.e. foundation) models upon which LLMs optimized for conversation with humans are built. However, the weak performance of the base models at coherently answering the tests’ questions makes this subset of results inconclusive. Finally, I demonstrate that LLMs can be steered towards specific locations in the political spectrum through Supervised Fine-Tuning (SFT) with only modest amounts of politically aligned data, suggesting SFT’s potential to embed political orientation in LLMs. With LLMs beginning to partially displace traditional information sources like search engines and Wikipedia, the societal implications of political biases embedded in LLMs are substantial.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- ECL, Otago Polytechnic, Dunedin, New Zealand.
ORCID-Profile: David Rozado
Förderung
- Institute for Cultural Evolution
Zitieren
APA
Rozado, D. (2024). The political preferences of LLMs. PLOS ONE, 19(7), e0306621. https://doi.org/10.1371/journal.pone.0306621
Vancouver
Rozado D. The political preferences of LLMs. PLOS ONE. 2024;19(7):e0306621. doi:10.1371/journal.pone.0306621
BibTeX
@article{Rozado2024,
author = {Rozado, David},
title = {The political preferences of LLMs},
journal = {PLOS ONE},
year = {2024},
volume = {19},
number = {7},
pages = {e0306621},
doi = {10.1371/journal.pone.0306621}
}
EUVIMED