Illusory generalizability of clinical prediction models
Science · 12.01.2024 · 383 (6679) · 164-167
DOI: 10.1126/science.adg8538 ↗Kurz gefasst
Fachartikel in der Zeitschrift Science, erschienen am 12.01.2024. Verfasst von Adam M Chekroud und 11 weiteren Autor:innen. Beteiligte Einrichtung: Spring Health, New York City, NY 10010, USA. Hauptthemen laut MEDLINE: Antipsychotic Agents, Schizophrenia, Machine Learning. Die Arbeit wurde bisher 272-mal zitiert (Crossref) und nennt 42 Literaturangaben.
Abstract (Originalsprache)
It is widely hoped that statistical models can improve decision-making related to medical treatments. Because of the cost and scarcity of medical outcomes data, this hope is typically based on investigators observing a model’s success in one or two datasets or clinical contexts. We scrutinized this optimism by examining how well a machine learning model performed across several independent clinical trials of antipsychotic medication for schizophrenia. Models predicted patient outcomes with high accuracy within the trial in which the model was developed but performed no better than chance when applied out-of-sample. Pooling data across trials to predict outcomes in the trial left out did not improve predictions. These results suggest that models predicting treatment outcomes in schizophrenia are highly context-dependent and may have limited generalizability.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Substanzen
Autor:innen und Institutionen
- Spring Health, New York City, NY 10010, USA.
- Department of Psychiatry, Yale University School of Medicine, New Haven, CT 06520, USA.
- Department of Biostatistics, Yale University, New Haven, CT 06520, USA.
- Department of Psychiatry, Psychotherapy and Psychosomatics, University Augsburg, 86159 Augsburg, Germany.
- Department of Psychiatry and Psychotherapy, University of Cologne, Faculty of Medicine and University Hospital of Cologne, Cologne, Germany.
- Department of Psychiatry and Psychotherapy, Ludwig-Maximilians-University, Munich, Germany.
ORCID-Profile: Adam M Chekroud, Matt Hawrilenko, Hieronimus Loho, Julia Bondar, Ralitza Gueorguieva, Joseph Kambeitz, Philip R Corlett, Nikolaos Koutsouleris, Harlan M Krumholz, John H Krystal, Martin Paulus
Zitieren
APA
Chekroud, A. M., Hawrilenko, M., Loho, H., Bondar, J., Gueorguieva, R., Hasan, A., Kambeitz, J., Corlett, P. R., Koutsouleris, N., Krumholz, H. M., Krystal, J. H., & Paulus, M. (2024). Illusory generalizability of clinical prediction models. Science, 383(6679), 164-167. https://doi.org/10.1126/science.adg8538
Vancouver
Chekroud AM, Hawrilenko M, Loho H, Bondar J, Gueorguieva R, Hasan A, et al. Illusory generalizability of clinical prediction models. Science. 2024;383(6679):164-167. doi:10.1126/science.adg8538
BibTeX
@article{Chekroud2024,
author = {Chekroud, Adam M and Hawrilenko, Matt and Loho, Hieronimus and Bondar, Julia and Gueorguieva, Ralitza and Hasan, Alkomiet and Kambeitz, Joseph and Corlett, Philip R and Koutsouleris, Nikolaos and Krumholz, Harlan M and Krystal, John H and Paulus, Martin},
title = {Illusory generalizability of clinical prediction models},
journal = {Science},
year = {2024},
volume = {383},
number = {6679},
pages = {164--167},
doi = {10.1126/science.adg8538}
}
EUVIMED