Determinants of Trust and Reliance on Artificial Intelligence in Clinical Settings: A Study on Physicians’ Use of Large Language Model in Psychiatric Symptom Assessment
Psychiatry Investigation · 25.08.2026 · 23 (8) · 1035-1046
DOI: 10.30773/pi.2025.0330 ↗Kurz gefasst
Fachartikel in der Zeitschrift Psychiatry Investigation, erschienen am 25.08.2026. Verfasst von Ji-Min Kim und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Neuropsychiatry, Daejeon Eulji Medical Center, Daejeon, Republic of Korea. Die Arbeit nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: Daeho Ethnic Psychiatry Research Fund, Korean Foundation of Neuropsychiatric Research.
Abstract (Originalsprache)
Objective
This study investigated physicians’ use of large language model (LLM)-generated assessments in psychiatric symptom evaluation and factors influencing their acceptance of artificial intelligence (AI) suggestions.
Methods
Twelve psychiatrists evaluated 50 anonymized psychiatric case vignettes, rating the presence and severity of 73 symptoms using a 4-point Likert scale. After initial assessment, they reviewed GPT-4o’s symptom ratings and could revise their evaluations. Accuracy was measured against a gold standard established by expert consensus. We computed initial (I), LLM (L), and revised (R) accuracy scores using percent agreement and weighted kappa. Performance improvement was measured by relative kappa increase. Regression analyses examined the influence of task difficulty and user competence on accuracy improvement.
Results
LLM assessments outperformed initial physician ratings in both agreement (90.4% vs. 82.9%, p
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Neuropsychiatry, Daejeon Eulji Medical Center, Daejeon, Republic of Korea.
- Department of Neuropsychiatry, Daejeon Eulji Medical Center, Daejeon, Republic of Korea. anselmjeong@gmail.com.
- Department of Neuropsychiatry, Eulji University School of Medicine, Daejeon, Republic of Korea. anselmjeong@gmail.com.
Förderung
- Daeho Ethnic Psychiatry Research Fund
- Korean Foundation of Neuropsychiatric Research
Zitieren
APA
Kim, J. M., & Jeong, S. H. (2026). Determinants of Trust and Reliance on Artificial Intelligence in Clinical Settings: A Study on Physicians’ Use of Large Language Model in Psychiatric Symptom Assessment. Psychiatry Investigation, 23(8), 1035-1046. https://doi.org/10.30773/pi.2025.0330
Vancouver
Kim JM, Jeong SH. Determinants of Trust and Reliance on Artificial Intelligence in Clinical Settings: A Study on Physicians’ Use of Large Language Model in Psychiatric Symptom Assessment. Psychiatry Investigation. 2026;23(8):1035-1046. doi:10.30773/pi.2025.0330
BibTeX
@article{Kim2026,
author = {Kim, Ji-Min and Jeong, Seong Hoon},
title = {Determinants of Trust and Reliance on Artificial Intelligence in Clinical Settings: A Study on Physicians’ Use of Large Language Model in Psychiatric Symptom Assessment},
journal = {Psychiatry Investigation},
year = {2026},
volume = {23},
number = {8},
pages = {1035--1046},
doi = {10.30773/pi.2025.0330}
}
EUVIMED