Cost-effective Missing Value Imputation for Data-effective Machine Learning
ACM Transactions on Database Systems · 30.09.2025 · 50 (3) · 1-36
DOI: 10.1145/3716376 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Database Systems, online erschienen am 14.05.2025. Verfasst von Chengliang Chai und 9 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 79 Literaturangaben. Gefördert von: National Key R&D Program of China, NSF of China, Shenzhen Project.
Abstract (Originalsprache)
Given a dataset with incomplete data (e.g., missing values), training a machine learning model over the incomplete data requires two steps. First, it requires a data-effective step that cleans the data in order to improve the data quality (and the model quality on the cleaned data). Second, it requires a data-efficient step that selects a core subset of the data (called coreset) such that the trained models on the entire data and the coreset have similar model quality, in order to save the computational cost of training. The first-data-effective-then-data-efficient methods are too costly, because they are expensive to clean the whole data; while the first-data-efficient-then-data-effective methods have low model quality, because they cannot select high-quality coreset for incomplete data. In this article, we investigate the problem of coreset selection over incomplete data for data-effective and data-efficient machine learning. The essential challenge is how to model the incomplete data for selecting high-quality coreset. To this end, we propose the GoodCore framework towards selecting a good coreset over incomplete data with low cost. To model the unknown complete data, we utilize the combinations of possible repairs as possible worlds of the incomplete data. Based on possible worlds, GoodCore selects an expected optimal coreset through gradient approximation without training ML models. We formally define the expected optimal coreset selection problem, prove its NP-hardness, and propose a greedy algorithm with an approximation ratio. To make GoodCore more efficient, we propose optimization methods that incorporate human-in-the-loop imputation or automatic imputation method into our framework. Moreover, a group-based strategy is utilized to further accelerate the coreset selection with incomplete data given large datasets. Experimental results show the effectiveness and efficiency of our framework with low cost.
Förderung
- National Key R&D Program of China
- NSF of China
- Shenzhen Project
- Zhongguancun Lab, Huawei, and Beijing National Research Center for Information Science and Technology
- National Key Research and Development Program of China
- NSFC
- CCF-Baidu Open Fund
- Huawei
Zitieren
APA
Chai, C., Jin, K., Tang, N., Fan, J., Miao, D., Wang, J., Luo, Y., Li, G., Yuan, Y., & Wang, G. (2025). Cost-effective Missing Value Imputation for Data-effective Machine Learning. ACM Transactions on Database Systems, 50(3), 1-36. https://doi.org/10.1145/3716376
Vancouver
Chai C, Jin K, Tang N, Fan J, Miao D, Wang J, et al. Cost-effective Missing Value Imputation for Data-effective Machine Learning. ACM Transactions on Database Systems. 2025;50(3):1-36. doi:10.1145/3716376
BibTeX
@article{Chai2025,
author = {Chai, Chengliang and Jin, Kaisen and Tang, Nan and Fan, Ju and Miao, Dongjing and Wang, Jiayi and Luo, Yuyu and Li, Guoliang and Yuan, Ye and Wang, Guoren},
title = {Cost-effective Missing Value Imputation for Data-effective Machine Learning},
journal = {ACM Transactions on Database Systems},
year = {2025},
volume = {50},
number = {3},
pages = {1--36},
doi = {10.1145/3716376}
}
EUVIMED