EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

When ELIZA meets therapists: A Turing test for the heart and mind

S Gabe Hatch iD, Zachary T Goodman, Laura Vowels, H Dorian Hatch iD, Alyssa L Brown, Shayna Guttman, Yunying Le, Benjamin Bailey iD, Russell J Bailey iD, Charlotte R Esplin, Steven M Harris iD, D Payton Holt und 6 weitere

PLOS Mental Health · 12.02.2025 · 2 (2) · e0000145

DOI: 10.1371/journal.pmen.0000145 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS Mental Health, online erschienen am 12.02.2025. Verfasst von S Gabe Hatch und 17 weiteren Autor:innen. Beteiligte Einrichtung: Hatch Data and Mental Health, Orem, Utah, United States of America. Die Arbeit wurde bisher 72-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

“Can machines be therapists?” is a question receiving increased attention given the relative ease of working with generative artificial intelligence. Although recent (and decades-old) research has found that humans struggle to tell the difference between responses from machines and humans, recent findings suggest that artificial intelligence can write empathically and the generated content is rated highly by therapists and outperforms professionals. It is uncertain whether, in a preregistered competition where therapists and ChatGPT respond to therapeutic vignettes about couple therapy, a) a panel of participants can tell which responses are ChatGPT-generated and which are written by therapists (N = 13), b) the generated responses or the therapist-written responses fall more in line with key therapy principles, and c) linguistic differences between conditions are present. In a large sample (N = 830), we showed that a) participants could rarely tell the difference between responses written by ChatGPT and responses written by a therapist, b) the responses written by ChatGPT were generally rated higher in key psychotherapy principles, and c) the language patterns between ChatGPT and therapists were different. Using different measures, we then confirmed that responses written by ChatGPT were rated higher than the therapist’s responses suggesting these differences may be explained by part-of-speech and response sentiment. This may be an early indication that ChatGPT has the potential to improve psychotherapeutic processes. We anticipate that this work may lead to the development of different methods of testing and creating psychotherapeutic interventions. Further, we discuss limitations (including the lack of the therapeutic context), and how continued research in this area may lead to improved efficacy of psychotherapeutic interventions allowing such interventions to be placed in the hands of individuals who need them the most.

Autor:innen und Institutionen

  • Hatch Data and Mental Health, Orem, Utah, United States of America.
  • Department of Psychiatry, University of California San Diego, San Diego, California, United States of America.
  • Department of Psychology, University of Lausanne, Lausanne, Switzerland.
  • Department of Psychology, The Ohio State University, Columbus, Ohio, United States of America.
  • Department of Psychology, Brigham Young University, Provo, Utah, United States of America.
  • Department of Psychology, University of Miami, Coral Gables, Florida, United States of America.

ORCID-Profile: S Gabe Hatch, H Dorian Hatch, Benjamin Bailey, Russell J Bailey, Steven M Harris, Merranda McLaughlin, D Nicholas Top

Zitieren

APA

Hatch, S. G., Goodman, Z. T., Vowels, L., Hatch, H. D., Brown, A. L., Guttman, S., Le, Y., Bailey, B., Bailey, R. J., Esplin, C. R., Harris, S. M., Holt, D. P., McLaughlin, M., O'Connell, P., Rothman, K., Ritchie, L., Top, D. N., & Braithwaite, S. R. (2025). When ELIZA meets therapists: A Turing test for the heart and mind. PLOS Mental Health, 2(2), e0000145. https://doi.org/10.1371/journal.pmen.0000145

Vancouver

Hatch SG, Goodman ZT, Vowels L, Hatch HD, Brown AL, Guttman S, et al. When ELIZA meets therapists: A Turing test for the heart and mind. PLOS Mental Health. 2025;2(2):e0000145. doi:10.1371/journal.pmen.0000145

BibTeX
@article{Hatch2025,
  author = {Hatch, S Gabe and Goodman, Zachary T and Vowels, Laura and Hatch, H Dorian and Brown, Alyssa L and Guttman, Shayna and Le, Yunying and Bailey, Benjamin and Bailey, Russell J and Esplin, Charlotte R and Harris, Steven M and Holt, D Payton and McLaughlin, Merranda and O'Connell, Patrick and Rothman, Karen and Ritchie, Lane and Top, D Nicholas and Braithwaite, Scott R},
  title = {When ELIZA meets therapists: A Turing test for the heart and mind},
  journal = {PLOS Mental Health},
  year = {2025},
  volume = {2},
  number = {2},
  pages = {e0000145},
  doi = {10.1371/journal.pmen.0000145}
}
Kostenlos starten →