EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

ChatGPT’s advice is perceived as better than that of professional advice columnists

Piers Douglas Lionel Howe, Nicolas Fay, Morgan Saletta, Eduard Hovy

Frontiers in Psychology · 21.11.2023 · 14

DOI: 10.3389/fpsyg.2023.1281255 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Psychology, online erschienen am 21.11.2023. Verfasst von Piers Douglas Lionel Howe und 3 weiteren Autor:innen. Beteiligte Einrichtung: Complex Human Data Hub, Melbourne School of Psychological Sciences, University of Melbourne, Melbourne, VIC, Australia. Die Arbeit wurde bisher 44-mal zitiert (Crossref) und nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Australian Research Council.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

ChatGPT is a high-performance large language model that has the potential to significantly improve human-computer interactions. It can provide advice on a range of topics, but it is unclear how good this advice is relative to that provided by competent humans, especially in situations where empathy is required. Here, we report the first investigation of whether ChatGPT’s responses are perceived as better than those of humans in a task where humans were attempting to be empathetic. Fifty social dilemma questions were randomly selected from 10 well-known advice columns. In a pre-registered survey, participants ( N = 404) were each shown one question, along with the corresponding response by an advice columnist and by ChatGPT. ChatGPT’s advice was perceived as more balanced, complete, empathetic, helpful, and better than the advice provided by professional advice columnists (all values of p < 0.001). Although participants could not determine which response was written by ChatGPT (54%, p = 0.29), most participants preferred that their own social dilemma questions be answered by a human than by a computer (77%, p < 0.001). ChatGPT’s responses were longer than those produced by the advice columnists (mean 280.9 words vs. 142.2 words, p < 0.001). In a second pre-registered survey, each ChatGPT answer was constrained to be approximately the same length as that of the advice columnist (mean 143.2 vs. 142.2 words, p = 0.95). This survey ( N = 401) replicated the above findings, showing that the benefit of ChatGPT was not solely due to it writing longer answers.

Schlagwörter

Stichwörter der Autor:innen

ChatGPTadviceadvice columnagony auntempathy

Autor:innen und Institutionen

  • Complex Human Data Hub, Melbourne School of Psychological Sciences, University of Melbourne, Melbourne, VIC, Australia.
  • School of Psychological Science, University of Western Australia, Perth, WA, Australia.
  • Hunt Laboratory, University of Melbourne, Melbourne, VIC, Australia.
  • Melbourne Connect, University of Melbourne, Melbourne, VIC, Australia.

Förderung

  • Australian Research Council

Zitieren

APA

Howe, P. D. L., Fay, N., Saletta, M., & Hovy, E. (2023). ChatGPT’s advice is perceived as better than that of professional advice columnists. Frontiers in Psychology, 14. https://doi.org/10.3389/fpsyg.2023.1281255

Vancouver

Howe PDL, Fay N, Saletta M, Hovy E. ChatGPT’s advice is perceived as better than that of professional advice columnists. Frontiers in Psychology. 2023;14. doi:10.3389/fpsyg.2023.1281255

BibTeX
@article{Howe2023,
  author = {Howe, Piers Douglas Lionel and Fay, Nicolas and Saletta, Morgan and Hovy, Eduard},
  title = {ChatGPT’s advice is perceived as better than that of professional advice columnists},
  journal = {Frontiers in Psychology},
  year = {2023},
  volume = {14},
  doi = {10.3389/fpsyg.2023.1281255}
}
Kostenlos starten →