External Validation of a Machine Learning Model for Schizophrenia Classification
Journal of Clinical Medicine · 17.05.2024 · 13 (10) · 2970
DOI: 10.3390/jcm13102970 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Clinical Medicine, online erschienen am 17.05.2024. Verfasst von Yupeng He und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Public Health, Fujita Health University School of Medicine, Toyoake 470-1192, Japan. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministry of Health Labour and Welfare, Ministry of Health, Labour and Welfare.
Abstract (Originalsprache)
Background and Objective: Excellent generalizability is the precondition for the widespread practical implementation of machine learning models. In our previous study, we developed the schizophrenia classification model (SZ classifier) to identify potential schizophrenia patients in the Japanese population. The SZ classifier has exhibited impressive performance during internal validation. However, ensuring the robustness and generalizability of the SZ classifier requires external validation across independent sample sets. In this study, we aimed to present an external validation of the SZ classifier using outpatient data.
Methods
The SZ classifier was trained by using online survey data, which incorporate demographic, health-related, and social comorbidity features. External validation was conducted using an outpatient sample set which is independent from the sample set during the model development phase. The model performance was assessed based on the sensitivity and misclassification rates for schizophrenia, bipolar disorder, and major depression patients.
Results
The SZ classifier demonstrated a sensitivity of 0.75 when applied to schizophrenia patients. The misclassification rates were 59% and 55% for bipolar disorder and major depression patients, respectively.
Conclusions
The SZ classifier currently encounters challenges in accurately determining the presence or absence of schizophrenia at the individual level. Prior to widespread practical implementation, enhancements are necessary to bolster the accuracy and diminish the misclassification rates. Despite the current limitations of the model, such as poor specificity for certain psychiatric disorders, there is potential for improvement if including multiple types of psychiatric disorders during model development.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Public Health, Fujita Health University School of Medicine, Toyoake 470-1192, Japan.
- Department of Psychiatry, Fujita Health University School of Medicine, Toyoake 470-1192, Japan.
- Department of Public Health and Health Systems, Nagoya University Graduate School of Medicine, Nagoya 466-8550, Japan.
- Department of Public Health, School of Medicine, Kurume University, Kurume 830-0011, Japan.
ORCID-Profile: Yupeng He, Yuanying Li, Masaaki Matsunaga, Atsuhiko Ota
Förderung
- Ministry of Health Labour and Welfare
- Ministry of Health, Labour and Welfare
Zitieren
APA
He, Y., Sakuma, K., Kishi, T., Li, Y., Matsunaga, M., Tanihara, S., Iwata, N., & Ota, A. (2024). External Validation of a Machine Learning Model for Schizophrenia Classification. Journal of Clinical Medicine, 13(10), 2970. https://doi.org/10.3390/jcm13102970
Vancouver
He Y, Sakuma K, Kishi T, Li Y, Matsunaga M, Tanihara S, et al. External Validation of a Machine Learning Model for Schizophrenia Classification. Journal of Clinical Medicine. 2024;13(10):2970. doi:10.3390/jcm13102970
BibTeX
@article{He2024,
author = {He, Yupeng and Sakuma, Kenji and Kishi, Taro and Li, Yuanying and Matsunaga, Masaaki and Tanihara, Shinichi and Iwata, Nakao and Ota, Atsuhiko},
title = {External Validation of a Machine Learning Model for Schizophrenia Classification},
journal = {Journal of Clinical Medicine},
year = {2024},
volume = {13},
number = {10},
pages = {2970},
doi = {10.3390/jcm13102970}
}
EUVIMED