EUVIMEDEUVIMED entdecken
Open Access

Evaluating the Influence of Role-Playing Prompts on ChatGPT’s Misinformation Detection Accuracy: Quantitative Study

Michael Robert Haupt iD, Luning Yang iD, Tina Purnat iD, Tim Mackey iD

JMIR Infodemiology · 26.09.2024 · 4 · e60678

DOI: 10.2196/60678 ↗

Kurz gefasst

Fachartikel in der Zeitschrift JMIR Infodemiology, online erschienen am 26.09.2024. Verfasst von Michael Robert Haupt und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Cognitive Science, University of California, San Diego, La Jolla, CA, United States. Hauptthemen laut MEDLINE: COVID-19, Communication, Social Media, Role Playing. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 62 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

During the COVID-19 pandemic, the rapid spread of misinformation on social media created significant public health challenges. Large language models (LLMs), pretrained on extensive textual data, have shown potential in detecting misinformation, but their performance can be influenced by factors such as prompt engineering (ie, modifying LLM requests to assess changes in output). One form of prompt engineering is role-playing, where, upon request, OpenAI’s ChatGPT imitates specific social roles or identities. This research examines how ChatGPT’s accuracy in detecting COVID-19–related misinformation is affected when it is assigned social identities in the request prompt. Understanding how LLMs respond to different identity cues can inform messaging campaigns, ensuring effective use in public health communications.

Objective

This study investigates the impact of role-playing prompts on ChatGPT’s accuracy in detecting misinformation. This study also assesses differences in performance when misinformation is explicitly stated versus implied, based on contextual knowledge, and examines the reasoning given by ChatGPT for classification decisions.

Methods

Overall, 36 real-world tweets about COVID-19 collected in September 2021 were categorized into misinformation, sentiment (opinions aligned vs unaligned with public health guidelines), corrections, and neutral reporting. ChatGPT was tested with prompts incorporating different combinations of multiple social identities (ie, political beliefs, education levels, locality, religiosity, and personality traits), resulting in 51,840 runs. Two control conditions were used to compare results: prompts with no identities and those including only political identity.

Results

The findings reveal that including social identities in prompts reduces average detection accuracy, with a notable drop from 68.1% (SD 41.2%; no identities) to 29.3% (SD 31.6%; all identities included). Prompts with only political identity resulted in the lowest accuracy (19.2%, SD 29.2%). ChatGPT was also able to distinguish between sentiments expressing opinions not aligned with public health guidelines from misinformation making declarative statements. There were no consistent differences in performance between explicit and implicit misinformation requiring contextual knowledge. While the findings show that the inclusion of identities decreased detection accuracy, it remains uncertain whether ChatGPT adopts views aligned with social identities: when assigned a conservative identity, ChatGPT identified misinformation with nearly the same accuracy as it did when assigned a liberal identity. While political identity was mentioned most frequently in ChatGPT’s explanations for its classification decisions, the rationales for classifications were inconsistent across study conditions, and contradictory explanations were provided in some instances.

Conclusions

These results indicate that ChatGPT’s ability to classify misinformation is negatively impacted when role-playing social identities, highlighting the complexity of integrating human biases and perspectives in LLMs. This points to the need for human oversight in the use of LLMs for misinformation detection. Further research is needed to understand how LLMs weigh social identities in prompt-based tasks and explore their application in different cultural contexts.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

COVID-19CommunicationSocial MediaRole PlayingHumansPandemicsSARS-CoV-2Public Health

Stichwörter der Autor:innen

AICOVID-19ChatGPTartificial intelligenceexperimentlarge language modelsmisinformation detectionprompt engineeringrole-playingsocial identity

Autor:innen und Institutionen

  • Department of Cognitive Science, University of California, San Diego, La Jolla, CA, United States.
  • Global Health Program, Department of Anthropology, University of California, San Diego, La Jolla, CA, United States.
  • Global Health Policy & Data Institute, San Diego, CA, United States.
  • TH Chan School of Public Health, Harvard University, Boston, MA, United States.
  • S-3 Research, San Diego, CA, United States.

ORCID-Profile: Michael Robert Haupt, Luning Yang, Tina Purnat, Tim Mackey

Zitieren

APA

Haupt, M. R., Yang, L., Purnat, T., & Mackey, T. (2024). Evaluating the Influence of Role-Playing Prompts on ChatGPT’s Misinformation Detection Accuracy: Quantitative Study. JMIR Infodemiology, 4, e60678. https://doi.org/10.2196/60678

Vancouver

Haupt MR, Yang L, Purnat T, Mackey T. Evaluating the Influence of Role-Playing Prompts on ChatGPT’s Misinformation Detection Accuracy: Quantitative Study. JMIR Infodemiology. 2024;4:e60678. doi:10.2196/60678

BibTeX
@article{Haupt2024,
  author = {Haupt, Michael Robert and Yang, Luning and Purnat, Tina and Mackey, Tim},
  title = {Evaluating the Influence of Role-Playing Prompts on ChatGPT’s Misinformation Detection Accuracy: Quantitative Study},
  journal = {JMIR Infodemiology},
  year = {2024},
  volume = {4},
  pages = {e60678},
  doi = {10.2196/60678}
}
Kostenlos starten →