EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Predicting Remission in Schizophrenia Using Machine Learning—Assessing the Impact of Sample Size and Predictor Overinclusion

Fredrik Hieronymus iD, Magnus Hieronymus, Axel Sjöstedt, Staffan Nilsson, Jakob Näslund, Alexander Lisinski, Søren Dinesen Østergaard iD

Acta Psychiatrica Scandinavica · 2025

DOI: 10.1111/acps.70037 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Acta Psychiatrica Scandinavica, 2025. Verfasst von Fredrik Hieronymus und 6 weiteren Autor:innen. Beteiligte Einrichtung: Institute of Neuroscience and Physiology, University of Gothenburg, Gothenburg, Sweden. Hauptthemen laut MEDLINE: Schizophrenia, Antipsychotic Agents, Machine Learning, Risperidone. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Lundbeck Foundation, Swedish Research Council, Vetenskapsrådet.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Introduction

Machine learning studies sometimes include a high number of predictors relative to the number of training cases. This increases the risk of overfitting and poor generalizability. A recent study hypothesized that between‐trial heterogeneity precluded generalizable outcome prediction in schizophrenia from being achieved. However, an alternative explanation is that predictor overinclusion might explain the low generalizability in that analysis.

Methods

Positive and Negative Syndrome Scale (PANSS) item‐data, age, sex, and treatment allocation (antipsychotic/placebo) from 18 placebo‐controlled trials of risperidone and paliperidone, in schizophrenia or schizoaffective disorder, were used as predictors for training five supervised learning models to predict symptom remission after 4 weeks of treatment. Sensitivity analyses varying the number of training cases and including simulated uninformative predictors were conducted to assess model performance, as were analyses on simulated data.

Results

Better‐than‐chance predictions could be achieved for all models using as few as 384 training cases (BAC 0.60, SD 0.035 for an ensemble model). Model performance increased with the number of training cases ( n = 4384, BAC 0.63, SD 0.041) and was higher when validated on a set of unseen trials without placebo controls ( n = 1508, BAC 0.68, SD 0.013). Predictive performance was substantially decreased by including simulated uninformative predictors. Analyses of simulated data suggest that considerably larger sample sizes than commonly used might be required to effectively separate weakly informative from uninformative predictors.

Conclusion

Supervised learning models can generate better‐than‐chance predictions in schizophrenia from small datasets, but this requires that not too many uninformative predictors are included. Since highly predictive models have not yet been established for schizophrenia—and since strong linear predictors are easy to identify—commonly collected clinical trial data likely do not contain predictors with strong linear relations to clinically relevant outcomes. If correct, future machine learning analyses should focus on maximizing the probability of identifying weakly predictive features.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

SchizophreniaAntipsychotic AgentsMachine LearningRisperidonePsychotic DisordersSupervised Machine LearningHumansMaleFemaleAdultSample SizeRemission InductionPaliperidone PalmitateMiddle Aged

Stichwörter der Autor:innen

item‐level analysismachine learningschizoaffective disorderschizophreniasupervised learningsymptom remissionsymptom‐level analysis

Substanzen

Antipsychotic AgentsRisperidonePaliperidone Palmitate

Autor:innen und Institutionen

  • Institute of Neuroscience and Physiology, University of Gothenburg, Gothenburg, Sweden.
  • Department of Clinical Medicine, Aarhus University, Aarhus, Denmark.
  • Swedish Meteorological and Hydrological Institute, Norrköping, Sweden.
  • Institute of Laboratory Medicine, University of Gothenburg, Gothenburg, Sweden.
  • Department of Affective Disorders, Aarhus University Hospital-Psychiatry, Aarhus, Denmark.

ORCID-Profile: Fredrik Hieronymus, Søren Dinesen Østergaard

Förderung

  • Lundbeck Foundation
  • Swedish Research Council
  • Vetenskapsrådet

Zitieren

APA

Hieronymus, F., Hieronymus, M., Sjöstedt, A., Nilsson, S., Näslund, J., Lisinski, A., & Østergaard, S. D. (2025). Predicting Remission in Schizophrenia Using Machine Learning—Assessing the Impact of Sample Size and Predictor Overinclusion. Acta Psychiatrica Scandinavica. https://doi.org/10.1111/acps.70037

Vancouver

Hieronymus F, Hieronymus M, Sjöstedt A, Nilsson S, Näslund J, Lisinski A, et al. Predicting Remission in Schizophrenia Using Machine Learning—Assessing the Impact of Sample Size and Predictor Overinclusion. Acta Psychiatrica Scandinavica. 2025. doi:10.1111/acps.70037

BibTeX
@article{Hieronymus2025,
  author = {Hieronymus, Fredrik and Hieronymus, Magnus and Sjöstedt, Axel and Nilsson, Staffan and Näslund, Jakob and Lisinski, Alexander and Østergaard, Søren Dinesen},
  title = {Predicting Remission in Schizophrenia Using Machine Learning—Assessing the Impact of Sample Size and Predictor Overinclusion},
  journal = {Acta Psychiatrica Scandinavica},
  year = {2025},
  doi = {10.1111/acps.70037}
}
Kostenlos starten →