Optimal ratio for data splitting
Statistical Analysis and Data Mining: The ASA Data Science Journal · 2022-08 · 15 (4) · 531-538
DOI: 10.1002/sam.11583 ↗At a glance
Journal article in Statistical Analysis and Data Mining: The ASA Data Science Journal, published online on 2022-04-04. Written by V. Roshan Joseph. Cited 729 times so far (Crossref); 26 references. The full text is freely available (open access, CC BY-NC-ND 4.0). Funded by: Division of Chemical, Bioengineering, Environmental, and Transport Systems, Division of Civil, Mechanical and Manufacturing Innovation.
Abstract (original language)
It is common to split a dataset into training and testing sets before fitting a statistical or machine learning model. However, there is no clear guidance on how much data should be used for training and testing. In this article, we show that the optimal training/testing splitting ratio is , where is the number of parameters in a linear regression model that explains the data well.
Funding
- Division of Chemical, Bioengineering, Environmental, and Transport Systems
- Division of Civil, Mechanical and Manufacturing Innovation
Cite
APA
Joseph, V. R. (2022). Optimal ratio for data splitting. Statistical Analysis and Data Mining: The ASA Data Science Journal, 15(4), 531-538. https://doi.org/10.1002/sam.11583
Vancouver
Joseph VR. Optimal ratio for data splitting. Statistical Analysis and Data Mining: The ASA Data Science Journal. 2022;15(4):531-538. doi:10.1002/sam.11583
BibTeX
@article{Joseph2022,
author = {Joseph, V. Roshan},
title = {Optimal ratio for data splitting},
journal = {Statistical Analysis and Data Mining: The ASA Data Science Journal},
year = {2022},
volume = {15},
number = {4},
pages = {531--538},
doi = {10.1002/sam.11583}
}
EUVIMED