EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

External Validation of a Machine Learning Model for Schizophrenia Classification

Yupeng He iD, Kenji Sakuma, Taro Kishi, Yuanying Li iD, Masaaki Matsunaga iD, Shinichi Tanihara, Nakao Iwata, Atsuhiko Ota iD

Journal of Clinical Medicine · 17.05.2024 · 13 (10) · 2970

DOI: 10.3390/jcm13102970 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Clinical Medicine, online erschienen am 17.05.2024. Verfasst von Yupeng He und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Public Health, Fujita Health University School of Medicine, Toyoake 470-1192, Japan. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministry of Health Labour and Welfare, Ministry of Health, Labour and Welfare.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background and Objective: Excellent generalizability is the precondition for the widespread practical implementation of machine learning models. In our previous study, we developed the schizophrenia classification model (SZ classifier) to identify potential schizophrenia patients in the Japanese population. The SZ classifier has exhibited impressive performance during internal validation. However, ensuring the robustness and generalizability of the SZ classifier requires external validation across independent sample sets. In this study, we aimed to present an external validation of the SZ classifier using outpatient data.

Methods

The SZ classifier was trained by using online survey data, which incorporate demographic, health-related, and social comorbidity features. External validation was conducted using an outpatient sample set which is independent from the sample set during the model development phase. The model performance was assessed based on the sensitivity and misclassification rates for schizophrenia, bipolar disorder, and major depression patients.

Results

The SZ classifier demonstrated a sensitivity of 0.75 when applied to schizophrenia patients. The misclassification rates were 59% and 55% for bipolar disorder and major depression patients, respectively.

Conclusions

The SZ classifier currently encounters challenges in accurately determining the presence or absence of schizophrenia at the individual level. Prior to widespread practical implementation, enhancements are necessary to bolster the accuracy and diminish the misclassification rates. Despite the current limitations of the model, such as poor specificity for certain psychiatric disorders, there is potential for improvement if including multiple types of psychiatric disorders during model development.

Schlagwörter

Stichwörter der Autor:innen

bipolarclassificationdepressionexternal validationmachine learningneural networkschizophrenia

Autor:innen und Institutionen

  • Department of Public Health, Fujita Health University School of Medicine, Toyoake 470-1192, Japan.
  • Department of Psychiatry, Fujita Health University School of Medicine, Toyoake 470-1192, Japan.
  • Department of Public Health and Health Systems, Nagoya University Graduate School of Medicine, Nagoya 466-8550, Japan.
  • Department of Public Health, School of Medicine, Kurume University, Kurume 830-0011, Japan.

ORCID-Profile: Yupeng He, Yuanying Li, Masaaki Matsunaga, Atsuhiko Ota

Förderung

  • Ministry of Health Labour and Welfare
  • Ministry of Health, Labour and Welfare

Zitieren

APA

He, Y., Sakuma, K., Kishi, T., Li, Y., Matsunaga, M., Tanihara, S., Iwata, N., & Ota, A. (2024). External Validation of a Machine Learning Model for Schizophrenia Classification. Journal of Clinical Medicine, 13(10), 2970. https://doi.org/10.3390/jcm13102970

Vancouver

He Y, Sakuma K, Kishi T, Li Y, Matsunaga M, Tanihara S, et al. External Validation of a Machine Learning Model for Schizophrenia Classification. Journal of Clinical Medicine. 2024;13(10):2970. doi:10.3390/jcm13102970

BibTeX
@article{He2024,
  author = {He, Yupeng and Sakuma, Kenji and Kishi, Taro and Li, Yuanying and Matsunaga, Masaaki and Tanihara, Shinichi and Iwata, Nakao and Ota, Atsuhiko},
  title = {External Validation of a Machine Learning Model for Schizophrenia Classification},
  journal = {Journal of Clinical Medicine},
  year = {2024},
  volume = {13},
  number = {10},
  pages = {2970},
  doi = {10.3390/jcm13102970}
}
Kostenlos starten →