Estimating the Minimum Sample Size for Neural Network Model Fitting—A Monte Carlo Simulation Study
Behavioral Sciences · 14.02.2025 · 15 (2) · 211
DOI: 10.3390/bs15020211 ↗Kurz gefasst
Fachartikel in der Zeitschrift Behavioral Sciences, online erschienen am 14.02.2025. Verfasst von Yongtian Cheng und 2 weiteren Autor:innen. Beteiligte Einrichtung: Division of Psychology and Language Sciences, University College London (UCL), 26 Bedford Way, London WC1H 0AP, UK. Die Arbeit wurde bisher 20-mal zitiert (Crossref) und nennt 83 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
In the era of machine learning, many psychological studies use machine learning methods. Specifically, neural networks, a set of machine learning methods that exhibit exceptional performance in various tasks, have been used on psychometric datasets for supervised model fitting. From the computer scientist’s perspective, psychometric independent variables are typically ordinal and low-dimensional—characteristics that can significantly impact model performance. To our knowledge, there is no guidance about the sample planning suggestion for this task. Therefore, we conducted a simulation study to test the performance of an NN with different sample sizes and the simulation of both linear and nonlinear relationships. We proposed the minimum sample size for the neural network model fitting with two criteria: the performance of 95% of the models is close to the theoretical maximum, and 80% of the models can outperform the linear model. The findings of this simulation study show that the performance of neural networks can be unstable with ordinal variables as independent variables, and we suggested that neural networks should not be used on ordinal independent variables with at least common nonlinear relationships in psychology. Further suggestions and research directions are also provided.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Division of Psychology and Language Sciences, University College London (UCL), 26 Bedford Way, London WC1H 0AP, UK.
- Department of Psychology, University of Manitoba, Winnipeg, MB R3T 2N2, Canada.
ORCID-Profile: Yongtian Cheng, Konstantinos Vassilis Petrides
Zitieren
APA
Cheng, Y., Petrides, K. V., & Li, J. (2025). Estimating the Minimum Sample Size for Neural Network Model Fitting—A Monte Carlo Simulation Study. Behavioral Sciences, 15(2), 211. https://doi.org/10.3390/bs15020211
Vancouver
Cheng Y, Petrides KV, Li J. Estimating the Minimum Sample Size for Neural Network Model Fitting—A Monte Carlo Simulation Study. Behavioral Sciences. 2025;15(2):211. doi:10.3390/bs15020211
BibTeX
@article{Cheng2025,
author = {Cheng, Yongtian and Petrides, Konstantinos Vassilis and Li, Johnson},
title = {Estimating the Minimum Sample Size for Neural Network Model Fitting—A Monte Carlo Simulation Study},
journal = {Behavioral Sciences},
year = {2025},
volume = {15},
number = {2},
pages = {211},
doi = {10.3390/bs15020211}
}
EUVIMED