Artificial intelligence conversational agents in mental health: Patients see potential, but prefer humans in the loop
Frontiers in Psychiatry · 31.01.2025 · 15
DOI: 10.3389/fpsyt.2024.1505024 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Psychiatry, online erschienen am 31.01.2025. Verfasst von Hyein S Lee und 11 weiteren Autor:innen. Beteiligte Einrichtung: Program in Digital Medicine, Department of Medicine, University of Massachusetts Chan Medical School, Worcester, MA, United States. Die Arbeit wurde bisher 63-mal zitiert (Crossref) und nennt 70 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Background
Digital mental health interventions, such as artificial intelligence (AI) conversational agents, hold promise for improving access to care by innovating therapy and supporting delivery. However, little research exists on patient perspectives regarding AI conversational agents, which is crucial for their successful implementation. This study aimed to fill the gap by exploring patients’ perceptions and acceptability of AI conversational agents in mental healthcare.
Methods
Adults with self-reported mild to moderate anxiety were recruited from the UMass Memorial Health system. Participants engaged in semi-structured interviews to discuss their experiences, perceptions, and acceptability of AI conversational agents in mental healthcare. Anxiety levels were assessed using the Generalized Anxiety Disorder scale. Data were collected from December 2022 to February 2023, and three researchers conducted rapid qualitative analysis to identify and synthesize themes.
Results
The sample included 29 adults (ages 19-66), predominantly under age 35, non-Hispanic, White, and female. Participants reported a range of positive and negative experiences with AI conversational agents. Most held positive attitudes towards AI conversational agents, appreciating their utility and potential to increase access to care, yet some also expressed cautious optimism. About half endorsed negative opinions, citing AI’s lack of empathy, technical limitations in addressing complex mental health situations, and data privacy concerns. Most participants desired some human involvement in AI-driven therapy and expressed concern about the risk of AI conversational agents being seen as replacements for therapy. A subgroup preferred AI conversational agents for administrative tasks rather than care provision.
Conclusions
AI conversational agents were perceived as useful and beneficial for increasing access to care, but concerns about AI’s empathy, capabilities, safety, and human involvement in mental healthcare were prevalent. Future implementation and integration of AI conversational agents should consider patient perspectives to enhance their acceptability and effectiveness.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Program in Digital Medicine, Department of Medicine, University of Massachusetts Chan Medical School, Worcester, MA, United States.
- Department of Population and Quantitative Health Sciences, University of Massachusetts Chan Medical School, Worcester, MA, United States.
- Ieso Digital Health, Cambridge, United Kingdom.
- Division of Health System Science, Department of Medicine, University of Massachusetts Chan Medical School, Worcester, MA, United States.
- Department of Emergency Medicine, University of Massachusetts Chan Medical School, Worcester, MA, United States.
- Department of Pediatrics, University of Massachusetts Chan Medical School, Worcester, MA, United States.
Zitieren
APA
Lee, H. S., Wright, C., Ferranto, J., Buttimer, J., Palmer, C. E., Welchman, A., Mazor, K. M., Fisher, K. A., Smelson, D., O'Connor, L., Fahey, N., & Soni, A. (2025). Artificial intelligence conversational agents in mental health: Patients see potential, but prefer humans in the loop. Frontiers in Psychiatry, 15. https://doi.org/10.3389/fpsyt.2024.1505024
Vancouver
Lee HS, Wright C, Ferranto J, Buttimer J, Palmer CE, Welchman A, et al. Artificial intelligence conversational agents in mental health: Patients see potential, but prefer humans in the loop. Frontiers in Psychiatry. 2025;15. doi:10.3389/fpsyt.2024.1505024
BibTeX
@article{Lee2025,
author = {Lee, Hyein S and Wright, Colton and Ferranto, Julia and Buttimer, Jessica and Palmer, Clare E and Welchman, Andrew and Mazor, Kathleen M and Fisher, Kimberly A and Smelson, David and O'Connor, Laurel and Fahey, Nisha and Soni, Apurv},
title = {Artificial intelligence conversational agents in mental health: Patients see potential, but prefer humans in the loop},
journal = {Frontiers in Psychiatry},
year = {2025},
volume = {15},
doi = {10.3389/fpsyt.2024.1505024}
}
EUVIMED