EUVIMEDEUVIMED entdecken
Randomisierte kontrollierte StudieOpen Access · CC BY-NC-ND 4.0

Doctors can agree: Enhancing interrater reliability of mental health diagnosis among junior psychiatrists using electronic clinician assisting technology

Yang S Liu, Lei Qian, Jian Xiang, Deborah Baofeng Wang, Jing Jiang, Ruijin Ni, Haibo Mao, Chongyu Cheng, Jianfeng Hong, Qinying Jiang, Hongshen Yang, Haiyun Xu und 6 weitere

Journal of Affective Disorders · 2026

DOI: 10.1016/j.jad.2025.121095 ↗

Kurz gefasst

Randomisierte kontrollierte Studie in der Zeitschrift Journal of Affective Disorders, 2026. Verfasst von Yang S Liu und 17 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychiatry, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, Alberta, Canada. Electronic address: ly6@ualberta.ca. Hauptthemen laut MEDLINE: Psychiatry, Electronic Health Records, Bipolar Disorder, Major Depressive Disorder. Die Arbeit nennt 20 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: Zhejiang Province Science and Technology Department, Wenzhou Municipal Science and Technology Bureau.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Interrater reliability in mental health diagnoses presents significant challenges, hindering consistent patient care. This study investigated the dual impact of clinicians' seniority and the use of an Electronic Medical Records (EMR) integrated Clinical Decision Support System (CDSS) on the diagnostic concordance of Major Depressive Disorder (MDD), Bipolar Disorder (BD), and Schizophrenia (SCZ). Seventy-two psychiatrists were randomly assigned to an EMR-assisted or a non-assisted control group, stratified by seniority. Participants diagnosed three cases based on video-recorded structured clinical interviews, and interrater reliability was assessed using Gwet's AC1. Results showed that seniority was a critical factor, with mid-level psychiatrists demonstrating higher reliability than their low-seniority counterparts. The CDSS intervention also significantly improved concordance. This effect was driven by dramatic improvements for mood disorders. The system's impact was negligible for SCZ, which showed high baseline agreement, and among high-seniority psychiatrists, who achieved perfect concordance regardless of CDSS use. This study underscores the potential of EMR-integrated CDSS to enhance psychiatric diagnostic consistency, likely by standardizing the evaluation process for less-experienced clinicians facing the complex differential diagnosis of mood disorders. These findings highlight the need to evaluate such systems in diverse clinical settings and across a broader spectrum of psychiatric conditions.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

PsychiatryElectronic Health RecordsBipolar DisorderMajor Depressive DisorderSchizophreniaDecision Support Systems, ClinicalPhysiciansHumansMaleFemaleReproducibility of ResultsAdultObserver VariationMiddle AgedPsychiatrists

Stichwörter der Autor:innen

Clinical Decision Support SystemClinician assistanceElectronic medical records assistanceInterrater reliabilityPsychiatric diagnosisSeniority

Autor:innen und Institutionen

  • Department of Psychiatry, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, Alberta, Canada. Electronic address: ly6@ualberta.ca.
  • Zhejiang Jerinte Health Technology Co, Ltd., Wenzhou, China; Department of Psychiatry, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, Alberta, Canada; Zhejiang Provincial Clinical Research Center fo…
  • Zhejiang Jerinte Health Technology Co, Ltd., Wenzhou, China; Zhejiang Provincial Clinical Research Center for Mental Disorders, The Affiliated Kangning Hospital, Wenzhou Medical University, Wenzhou, China.
  • Zhejiang Provincial Clinical Research Center for Mental Disorders, The Affiliated Kangning Hospital, Wenzhou Medical University, Wenzhou, China.
  • Department of Psychiatry, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, Alberta, Canada.
  • Department of Psychiatry, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, Alberta, Canada; Department of Computing Sciences, Faculty of Science, University of Alberta, Edmonton, Alberta, Canada.

Förderung

  • Zhejiang Province Science and Technology Department
  • Wenzhou Municipal Science and Technology Bureau

Zitieren

APA

Liu, Y. S., Qian, L., Xiang, J., Wang, D. B., Jiang, J., Ni, R., Mao, H., Cheng, C., Hong, J., Jiang, Q., Yang, H., Xu, H., Liu, J., Cai, X., Li, X. M., Cao, B., Greenshaw, A. J., & Xu, Y. (2026). Doctors can agree: Enhancing interrater reliability of mental health diagnosis among junior psychiatrists using electronic clinician assisting technology. Journal of Affective Disorders. https://doi.org/10.1016/j.jad.2025.121095

Vancouver

Liu YS, Qian L, Xiang J, Wang DB, Jiang J, Ni R, et al. Doctors can agree: Enhancing interrater reliability of mental health diagnosis among junior psychiatrists using electronic clinician assisting technology. Journal of Affective Disorders. 2026. doi:10.1016/j.jad.2025.121095

BibTeX
@article{Liu2026,
  author = {Liu, Yang S and Qian, Lei and Xiang, Jian and Wang, Deborah Baofeng and Jiang, Jing and Ni, Ruijin and Mao, Haibo and Cheng, Chongyu and Hong, Jianfeng and Jiang, Qinying and Yang, Hongshen and Xu, Haiyun and Liu, Jiahong and Cai, Xugong and Li, Xin-Min and Cao, Bo and Greenshaw, Andrew J and Xu, Yi},
  title = {Doctors can agree: Enhancing interrater reliability of mental health diagnosis among junior psychiatrists using electronic clinician assisting technology},
  journal = {Journal of Affective Disorders},
  year = {2026},
  doi = {10.1016/j.jad.2025.121095}
}
Kostenlos starten →