EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Estimating the Minimum Sample Size for Neural Network Model Fitting—A Monte Carlo Simulation Study

Yongtian Cheng iD, Konstantinos Vassilis Petrides iD, Johnson Li

Behavioral Sciences · 14.02.2025 · 15 (2) · 211

DOI: 10.3390/bs15020211 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Behavioral Sciences, online erschienen am 14.02.2025. Verfasst von Yongtian Cheng und 2 weiteren Autor:innen. Beteiligte Einrichtung: Division of Psychology and Language Sciences, University College London (UCL), 26 Bedford Way, London WC1H 0AP, UK. Die Arbeit wurde bisher 20-mal zitiert (Crossref) und nennt 83 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In the era of machine learning, many psychological studies use machine learning methods. Specifically, neural networks, a set of machine learning methods that exhibit exceptional performance in various tasks, have been used on psychometric datasets for supervised model fitting. From the computer scientist’s perspective, psychometric independent variables are typically ordinal and low-dimensional—characteristics that can significantly impact model performance. To our knowledge, there is no guidance about the sample planning suggestion for this task. Therefore, we conducted a simulation study to test the performance of an NN with different sample sizes and the simulation of both linear and nonlinear relationships. We proposed the minimum sample size for the neural network model fitting with two criteria: the performance of 95% of the models is close to the theoretical maximum, and 80% of the models can outperform the linear model. The findings of this simulation study show that the performance of neural networks can be unstable with ordinal variables as independent variables, and we suggested that neural networks should not be used on ordinal independent variables with at least common nonlinear relationships in psychology. Further suggestions and research directions are also provided.

Schlagwörter

Stichwörter der Autor:innen

neural networksordinal datasetpredictive performancereproducibilitysample size

Autor:innen und Institutionen

  • Division of Psychology and Language Sciences, University College London (UCL), 26 Bedford Way, London WC1H 0AP, UK.
  • Department of Psychology, University of Manitoba, Winnipeg, MB R3T 2N2, Canada.

ORCID-Profile: Yongtian Cheng, Konstantinos Vassilis Petrides

Zitieren

APA

Cheng, Y., Petrides, K. V., & Li, J. (2025). Estimating the Minimum Sample Size for Neural Network Model Fitting—A Monte Carlo Simulation Study. Behavioral Sciences, 15(2), 211. https://doi.org/10.3390/bs15020211

Vancouver

Cheng Y, Petrides KV, Li J. Estimating the Minimum Sample Size for Neural Network Model Fitting—A Monte Carlo Simulation Study. Behavioral Sciences. 2025;15(2):211. doi:10.3390/bs15020211

BibTeX
@article{Cheng2025,
  author = {Cheng, Yongtian and Petrides, Konstantinos Vassilis and Li, Johnson},
  title = {Estimating the Minimum Sample Size for Neural Network Model Fitting—A Monte Carlo Simulation Study},
  journal = {Behavioral Sciences},
  year = {2025},
  volume = {15},
  number = {2},
  pages = {211},
  doi = {10.3390/bs15020211}
}
Kostenlos starten →