EUVIMEDObjevte EUVIMED
Open access

Evaluating the Influence of Role-Playing Prompts on ChatGPT’s Misinformation Detection Accuracy: Quantitative Study

Michael Robert Haupt iD, Luning Yang iD, Tina Purnat iD, Tim Mackey iD

JMIR Infodemiology · 2024-09-26 · 4 · e60678

DOI: 10.2196/60678 ↗

At a glance

Journal article in JMIR Infodemiology, published online on 2024-09-26. Written by Michael Robert Haupt and 3 co-authors. Institution: Department of Cognitive Science, University of California, San Diego, La Jolla, CA, United States. Major MEDLINE topics: COVID-19, Communication, Social Media, Role Playing. Cited 13 times so far (Crossref); 62 references. The full text is freely available in PubMed Central.

AbstraktSubjectsBibliografické údajeCiteRelated studies

Abstract (original language)

Background

During the COVID-19 pandemic, the rapid spread of misinformation on social media created significant public health challenges. Large language models (LLMs), pretrained on extensive textual data, have shown potential in detecting misinformation, but their performance can be influenced by factors such as prompt engineering (ie, modifying LLM requests to assess changes in output). One form of prompt engineering is role-playing, where, upon request, OpenAI’s ChatGPT imitates specific social roles or identities. This research examines how ChatGPT’s accuracy in detecting COVID-19–related misinformation is affected when it is assigned social identities in the request prompt. Understanding how LLMs respond to different identity cues can inform messaging campaigns, ensuring effective use in public health communications.

Objective

This study investigates the impact of role-playing prompts on ChatGPT’s accuracy in detecting misinformation. This study also assesses differences in performance when misinformation is explicitly stated versus implied, based on contextual knowledge, and examines the reasoning given by ChatGPT for classification decisions.

Methods

Overall, 36 real-world tweets about COVID-19 collected in September 2021 were categorized into misinformation, sentiment (opinions aligned vs unaligned with public health guidelines), corrections, and neutral reporting. ChatGPT was tested with prompts incorporating different combinations of multiple social identities (ie, political beliefs, education levels, locality, religiosity, and personality traits), resulting in 51,840 runs. Two control conditions were used to compare results: prompts with no identities and those including only political identity.

Results

The findings reveal that including social identities in prompts reduces average detection accuracy, with a notable drop from 68.1% (SD 41.2%; no identities) to 29.3% (SD 31.6%; all identities included). Prompts with only political identity resulted in the lowest accuracy (19.2%, SD 29.2%). ChatGPT was also able to distinguish between sentiments expressing opinions not aligned with public health guidelines from misinformation making declarative statements. There were no consistent differences in performance between explicit and implicit misinformation requiring contextual knowledge. While the findings show that the inclusion of identities decreased detection accuracy, it remains uncertain whether ChatGPT adopts views aligned with social identities: when assigned a conservative identity, ChatGPT identified misinformation with nearly the same accuracy as it did when assigned a liberal identity. While political identity was mentioned most frequently in ChatGPT’s explanations for its classification decisions, the rationales for classifications were inconsistent across study conditions, and contradictory explanations were provided in some instances.

Conclusions

These results indicate that ChatGPT’s ability to classify misinformation is negatively impacted when role-playing social identities, highlighting the complexity of integrating human biases and perspectives in LLMs. This points to the need for human oversight in the use of LLMs for misinformation detection. Further research is needed to understand how LLMs weigh social identities in prompt-based tasks and explore their application in different cultural contexts.

Subjects

MeSH terms (MEDLINE)

COVID-19CommunicationSocial MediaRole PlayingHumansPandemicsSARS-CoV-2Public Health

Author keywords

AICOVID-19ChatGPTartificial intelligenceexperimentlarge language modelsmisinformation detectionprompt engineeringrole-playingsocial identity

Authors and institutions

  • Department of Cognitive Science, University of California, San Diego, La Jolla, CA, United States.
  • Global Health Program, Department of Anthropology, University of California, San Diego, La Jolla, CA, United States.
  • Global Health Policy & Data Institute, San Diego, CA, United States.
  • TH Chan School of Public Health, Harvard University, Boston, MA, United States.
  • S-3 Research, San Diego, CA, United States.

ORCID profiles: Michael Robert Haupt, Luning Yang, Tina Purnat, Tim Mackey

Cite

APA

Haupt, M. R., Yang, L., Purnat, T., & Mackey, T. (2024). Evaluating the Influence of Role-Playing Prompts on ChatGPT’s Misinformation Detection Accuracy: Quantitative Study. JMIR Infodemiology, 4, e60678. https://doi.org/10.2196/60678

Vancouver

Haupt MR, Yang L, Purnat T, Mackey T. Evaluating the Influence of Role-Playing Prompts on ChatGPT’s Misinformation Detection Accuracy: Quantitative Study. JMIR Infodemiology. 2024;4:e60678. doi:10.2196/60678

BibTeX
@article{Haupt2024,
  author = {Haupt, Michael Robert and Yang, Luning and Purnat, Tina and Mackey, Tim},
  title = {Evaluating the Influence of Role-Playing Prompts on ChatGPT’s Misinformation Detection Accuracy: Quantitative Study},
  journal = {JMIR Infodemiology},
  year = {2024},
  volume = {4},
  pages = {e60678},
  doi = {10.2196/60678}
}
Start for free →