EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Determinants of Trust and Reliance on Artificial Intelligence in Clinical Settings: A Study on Physicians’ Use of Large Language Model in Psychiatric Symptom Assessment

Ji-Min Kim, Seong Hoon Jeong

Psychiatry Investigation · 25.08.2026 · 23 (8) · 1035-1046

DOI: 10.30773/pi.2025.0330 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Psychiatry Investigation, erschienen am 25.08.2026. Verfasst von Ji-Min Kim und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Neuropsychiatry, Daejeon Eulji Medical Center, Daejeon, Republic of Korea. Die Arbeit nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: Daeho Ethnic Psychiatry Research Fund, Korean Foundation of Neuropsychiatric Research.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objective

This study investigated physicians’ use of large language model (LLM)-generated assessments in psychiatric symptom evaluation and factors influencing their acceptance of artificial intelligence (AI) suggestions.

Methods

Twelve psychiatrists evaluated 50 anonymized psychiatric case vignettes, rating the presence and severity of 73 symptoms using a 4-point Likert scale. After initial assessment, they reviewed GPT-4o’s symptom ratings and could revise their evaluations. Accuracy was measured against a gold standard established by expert consensus. We computed initial (I), LLM (L), and revised (R) accuracy scores using percent agreement and weighted kappa. Performance improvement was measured by relative kappa increase. Regression analyses examined the influence of task difficulty and user competence on accuracy improvement.

Results

LLM assessments outperformed initial physician ratings in both agreement (90.4% vs. 82.9%, p

Schlagwörter

Stichwörter der Autor:innen

Artificial intelligenceAttitude to computersClinical decision support systemsLarge language modelsNatural language processing

Autor:innen und Institutionen

  • Department of Neuropsychiatry, Daejeon Eulji Medical Center, Daejeon, Republic of Korea.
  • Department of Neuropsychiatry, Daejeon Eulji Medical Center, Daejeon, Republic of Korea. anselmjeong@gmail.com.
  • Department of Neuropsychiatry, Eulji University School of Medicine, Daejeon, Republic of Korea. anselmjeong@gmail.com.

Förderung

  • Daeho Ethnic Psychiatry Research Fund
  • Korean Foundation of Neuropsychiatric Research

Zitieren

APA

Kim, J. M., & Jeong, S. H. (2026). Determinants of Trust and Reliance on Artificial Intelligence in Clinical Settings: A Study on Physicians’ Use of Large Language Model in Psychiatric Symptom Assessment. Psychiatry Investigation, 23(8), 1035-1046. https://doi.org/10.30773/pi.2025.0330

Vancouver

Kim JM, Jeong SH. Determinants of Trust and Reliance on Artificial Intelligence in Clinical Settings: A Study on Physicians’ Use of Large Language Model in Psychiatric Symptom Assessment. Psychiatry Investigation. 2026;23(8):1035-1046. doi:10.30773/pi.2025.0330

BibTeX
@article{Kim2026,
  author = {Kim, Ji-Min and Jeong, Seong Hoon},
  title = {Determinants of Trust and Reliance on Artificial Intelligence in Clinical Settings: A Study on Physicians’ Use of Large Language Model in Psychiatric Symptom Assessment},
  journal = {Psychiatry Investigation},
  year = {2026},
  volume = {23},
  number = {8},
  pages = {1035--1046},
  doi = {10.30773/pi.2025.0330}
}
Kostenlos starten →