Helpful assistant or fruitful facilitator? Investigating how personas affect language model behavior
PLOS One · 30.06.2025 · 20 (6) · e0325664
DOI: 10.1371/journal.pone.0325664 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS One, online erschienen am 30.06.2025. Verfasst von Pedro Henrique Luz de Araujo und 1 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Computer Science, University of Vienna, Vienna, Austria. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 51 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC0). Gefördert von: Vienna Science and Technology Fund.
Abstract (Originalsprache)
One way to steer generations from large language models (LLM) is to assign a persona: a role that describes how the user expects the LLM to behave (e.g., a helpful assistant, a teacher, a woman). This paper investigates how personas affect diverse aspects of model behavior. We assign to seven LLMs 162 personas from 12 categories spanning variables like gender, sexual orientation, and occupation. We prompt them to answer questions from five datasets covering objective (e.g., questions about math and history) and subjective tasks (e.g., questions about beliefs and values). We also compare persona’s generations to two baseline settings: a control persona setting with 30 paraphrases of “a helpful assistant” to control for models’ prompt sensitivity, and an empty persona setting where no persona is assigned. We find that for all models and datasets, personas show greater variability than the control setting and that some measures of persona behavior generalize across models.
Autor:innen und Institutionen
- Faculty of Computer Science, University of Vienna, Vienna, Austria.
- Doctoral School Computer Science, Faculty of Computer Science, Vienna, Austria.
- Faculty of Philological and Cultural Studies, University of Vienna, Vienna, Austria.
ORCID-Profile: Pedro Henrique Luz de Araujo
Förderung
- Vienna Science and Technology Fund
Zitieren
APA
Luz de Araujo, P. H., & Roth, B. (2025). Helpful assistant or fruitful facilitator? Investigating how personas affect language model behavior. PLOS One, 20(6), e0325664. https://doi.org/10.1371/journal.pone.0325664
Vancouver
Luz de Araujo PH, Roth B. Helpful assistant or fruitful facilitator? Investigating how personas affect language model behavior. PLOS One. 2025;20(6):e0325664. doi:10.1371/journal.pone.0325664
BibTeX
@article{LuzdeAraujo2025,
author = {Luz de Araujo, Pedro Henrique and Roth, Benjamin},
title = {Helpful assistant or fruitful facilitator? Investigating how personas affect language model behavior},
journal = {PLOS One},
year = {2025},
volume = {20},
number = {6},
pages = {e0325664},
doi = {10.1371/journal.pone.0325664}
}
EUVIMED