Data Twinning
Statistical Analysis and Data Mining: The ASA Data Science Journal · 2022-10 · 15 (5) · 598-610
DOI: 10.1002/sam.11574 ↗At a glance
Journal article in Statistical Analysis and Data Mining: The ASA Data Science Journal, published online on 2022-02-15. Written by Akhil Vakayil and 1 co-authors. Cited 27 times so far (Crossref); 25 references. The full text is freely available (open access, CC BY-NC-ND 4.0). Funded by: Division of Chemical, Bioengineering, Environmental, and Transport Systems, Division of Civil, Mechanical and Manufacturing Innovation.
Abstract (original language)
In this work, we develop a method named Twinning for partitioning a dataset into statistically similar twin sets. Twinning is based on SPlit , a recently proposed model‐independent method for optimally splitting a dataset into training and testing sets. Twinning is orders of magnitude faster than the SPlit algorithm, which makes it applicable to Big Data problems such as data compression. Twinning can also be used for generating multiple splits of a given dataset to aid divide‐and‐conquer procedures and k ‐fold cross validation.
Funding
- Division of Chemical, Bioengineering, Environmental, and Transport Systems
- Division of Civil, Mechanical and Manufacturing Innovation
Cite
APA
Vakayil, A., & Joseph, V. R. (2022). Data Twinning. Statistical Analysis and Data Mining: The ASA Data Science Journal, 15(5), 598-610. https://doi.org/10.1002/sam.11574
Vancouver
Vakayil A, Joseph VR. Data Twinning. Statistical Analysis and Data Mining: The ASA Data Science Journal. 2022;15(5):598-610. doi:10.1002/sam.11574
BibTeX
@article{Vakayil2022,
author = {Vakayil, Akhil and Joseph, V. Roshan},
title = {Data Twinning},
journal = {Statistical Analysis and Data Mining: The ASA Data Science Journal},
year = {2022},
volume = {15},
number = {5},
pages = {598--610},
doi = {10.1002/sam.11574}
}
EUVIMED