Evaluating the Influence of Role-Playing Prompts on ChatGPT’s Misinformation Detection Accuracy: Quantitative Study
JMIR Infodemiology · 26.09.2024 · 4 · e60678
DOI: 10.2196/60678 ↗Kurz gefasst
Fachartikel in der Zeitschrift JMIR Infodemiology, online erschienen am 26.09.2024. Verfasst von Michael Robert Haupt und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Cognitive Science, University of California, San Diego, La Jolla, CA, United States. Hauptthemen laut MEDLINE: COVID-19, Communication, Social Media, Role Playing. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 62 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Background
During the COVID-19 pandemic, the rapid spread of misinformation on social media created significant public health challenges. Large language models (LLMs), pretrained on extensive textual data, have shown potential in detecting misinformation, but their performance can be influenced by factors such as prompt engineering (ie, modifying LLM requests to assess changes in output). One form of prompt engineering is role-playing, where, upon request, OpenAI’s ChatGPT imitates specific social roles or identities. This research examines how ChatGPT’s accuracy in detecting COVID-19–related misinformation is affected when it is assigned social identities in the request prompt. Understanding how LLMs respond to different identity cues can inform messaging campaigns, ensuring effective use in public health communications.
Objective
This study investigates the impact of role-playing prompts on ChatGPT’s accuracy in detecting misinformation. This study also assesses differences in performance when misinformation is explicitly stated versus implied, based on contextual knowledge, and examines the reasoning given by ChatGPT for classification decisions.
Methods
Overall, 36 real-world tweets about COVID-19 collected in September 2021 were categorized into misinformation, sentiment (opinions aligned vs unaligned with public health guidelines), corrections, and neutral reporting. ChatGPT was tested with prompts incorporating different combinations of multiple social identities (ie, political beliefs, education levels, locality, religiosity, and personality traits), resulting in 51,840 runs. Two control conditions were used to compare results: prompts with no identities and those including only political identity.
Results
The findings reveal that including social identities in prompts reduces average detection accuracy, with a notable drop from 68.1% (SD 41.2%; no identities) to 29.3% (SD 31.6%; all identities included). Prompts with only political identity resulted in the lowest accuracy (19.2%, SD 29.2%). ChatGPT was also able to distinguish between sentiments expressing opinions not aligned with public health guidelines from misinformation making declarative statements. There were no consistent differences in performance between explicit and implicit misinformation requiring contextual knowledge. While the findings show that the inclusion of identities decreased detection accuracy, it remains uncertain whether ChatGPT adopts views aligned with social identities: when assigned a conservative identity, ChatGPT identified misinformation with nearly the same accuracy as it did when assigned a liberal identity. While political identity was mentioned most frequently in ChatGPT’s explanations for its classification decisions, the rationales for classifications were inconsistent across study conditions, and contradictory explanations were provided in some instances.
Conclusions
These results indicate that ChatGPT’s ability to classify misinformation is negatively impacted when role-playing social identities, highlighting the complexity of integrating human biases and perspectives in LLMs. This points to the need for human oversight in the use of LLMs for misinformation detection. Further research is needed to understand how LLMs weigh social identities in prompt-based tasks and explore their application in different cultural contexts.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Cognitive Science, University of California, San Diego, La Jolla, CA, United States.
- Global Health Program, Department of Anthropology, University of California, San Diego, La Jolla, CA, United States.
- Global Health Policy & Data Institute, San Diego, CA, United States.
- TH Chan School of Public Health, Harvard University, Boston, MA, United States.
- S-3 Research, San Diego, CA, United States.
ORCID-Profile: Michael Robert Haupt, Luning Yang, Tina Purnat, Tim Mackey
Zitieren
APA
Haupt, M. R., Yang, L., Purnat, T., & Mackey, T. (2024). Evaluating the Influence of Role-Playing Prompts on ChatGPT’s Misinformation Detection Accuracy: Quantitative Study. JMIR Infodemiology, 4, e60678. https://doi.org/10.2196/60678
Vancouver
Haupt MR, Yang L, Purnat T, Mackey T. Evaluating the Influence of Role-Playing Prompts on ChatGPT’s Misinformation Detection Accuracy: Quantitative Study. JMIR Infodemiology. 2024;4:e60678. doi:10.2196/60678
BibTeX
@article{Haupt2024,
author = {Haupt, Michael Robert and Yang, Luning and Purnat, Tina and Mackey, Tim},
title = {Evaluating the Influence of Role-Playing Prompts on ChatGPT’s Misinformation Detection Accuracy: Quantitative Study},
journal = {JMIR Infodemiology},
year = {2024},
volume = {4},
pages = {e60678},
doi = {10.2196/60678}
}
EUVIMED