EUVIMEDSkopri EUVIMED
Systematische ÜbersichtOpen access

Effectiveness of Chatbots in Mental Health Screening and Assessment: Systematic Review

Isabel Morales Gil, Inés Marti-Estevez, Sandra Doval, José Miguel Gutiérrez-Carrillo, Rocío Fausor, Silvia Arribas-García, Miguel Ángel Álvarez-Mon, Javier Quintero

JMIR Mental Health · 2026-10-06 · 13 · e93672-e93672

DOI: 10.2196/93672 ↗

At a glance

Systematische Übersicht in JMIR Mental Health, published online on 2026-10-06. Written by Isabel Morales Gil and 7 co-authors. Institution: Universidad Internacional De La Rioja, Avenida de la Paz, Logroño, La Rioja, Spain, +34 941 20 97 43. Major MEDLINE topics: Generative Artificial Intelligence, Mass Screening, Mental Disorders. 49 references. The full text is freely available in PubMed Central.

AstrattSubjectsDettalji biblijografiċiCiteRelated studies

Abstract (original language)

Background

Mental health disorders affect 970 million people globally; yet, over 50% do not access timely evaluation due to structural barriers and professional shortages. Chatbots and AI-based conversational agents have emerged as promising tools for mental health screening and assessment.

Objective

This study systematically evaluated the effectiveness, accuracy, reliability, and acceptability of chatbots and AI-based conversational agents for mental health screening and assessment in adults.

Methods

Systematic search conducted in May 2025 across PubMed/MEDLINE, PsycINFO, Scopus, and Web of Science (2019‐2025), following PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) 2020 guidelines. Eligible studies evaluated chatbots or AI for mental health screening/assessment in adults (≥18 y). Risk of bias was assessed using appropriate tools (Risk of Bias 2, Quality Assessment of Diagnostic Accuracy Studies-2, Joanna Briggs Institute checklists, and Mixed Methods Appraisal Tool). This systematic review was registered with PROSPERO (International Prospective Register of Systematic Reviews; CRD420251072392).

Results

Eighteen studies (2021‐2025) were included, with samples ranging from 20 to 3902 participants. Rule-based chatbots demonstrated high reliability (Cronbach α >0.85) and good acceptability (Acceptability of Intervention Measure >19/25). Generative models (large language models) achieved sensitivities of 0.84 to 0.93 and specificities of 0.80 to 0.96 for depression and anxiety, with correlations up to r =0.96 with expert clinicians in suicide risk assessment. Hybrid approaches combining large language models with machine learning achieved exceptional performance for cognitive impairment ( F 1 -score of 92.1%, specificity of 99.6%). Most studies reported high user satisfaction (≥70%), although barriers existed among older populations. Methodological quality was heterogeneous with a moderate risk of bias in critical dimensions.

Conclusions

Chatbots and AI conversational agents demonstrate clinically relevant performance in mental health screening and assessment. However, safe implementation requires clear clinical protocols, professional supervision, integration with electronic health records, and active mitigation of algorithmic bias. These technologies should complement rather than replace clinical judgment.

Subjects

MeSH terms (MEDLINE)

Generative Artificial IntelligenceMass ScreeningMental DisordersHumansReproducibility of Results

Author keywords

AIchatbotslarge language modelsmental healthpsychological assessmentscreening

Authors and institutions

  • Universidad Internacional De La Rioja, Avenida de la Paz, Logroño, La Rioja, Spain, +34 941 20 97 43.
  • Hospital Infantil Universitario Niño Jesús, Madrid, Spain.
  • Gijón Hospital, Gijón, Spain.
  • Valencian International University, Valencia, Spain.
  • Department of Legal Medicine and Psychiatry, Complutense University, Madrid, Spain.
  • Department of Psychiatry, Infanta Leonor University Hospital, Madrid, Spain.

Cite

APA

Morales Gil, I., Marti-Estevez, I., Doval, S., Gutiérrez-Carrillo, J. M., Fausor, R., Arribas-García, S., Álvarez-Mon, M. Á., & Quintero, J. (2026). Effectiveness of Chatbots in Mental Health Screening and Assessment: Systematic Review. JMIR Mental Health, 13, e93672-e93672. https://doi.org/10.2196/93672

Vancouver

Morales Gil I, Marti-Estevez I, Doval S, Gutiérrez-Carrillo JM, Fausor R, Arribas-García S, et al. Effectiveness of Chatbots in Mental Health Screening and Assessment: Systematic Review. JMIR Mental Health. 2026;13:e93672-e93672. doi:10.2196/93672

BibTeX
@article{MoralesGil2026,
  author = {Morales Gil, Isabel and Marti-Estevez, Inés and Doval, Sandra and Gutiérrez-Carrillo, José Miguel and Fausor, Rocío and Arribas-García, Silvia and Álvarez-Mon, Miguel Ángel and Quintero, Javier},
  title = {Effectiveness of Chatbots in Mental Health Screening and Assessment: Systematic Review},
  journal = {JMIR Mental Health},
  year = {2026},
  volume = {13},
  pages = {e93672--e93672},
  doi = {10.2196/93672}
}
Start for free →