EUVIMEDEUVIMED entdecken
Crossref

Cost-effective Missing Value Imputation for Data-effective Machine Learning

Chengliang Chai, Kaisen Jin, Nan Tang, Ju Fan, Dongjing Miao, Jiayi Wang, Yuyu Luo, Guoliang Li, Ye Yuan, Guoren Wang

ACM Transactions on Database Systems · 30.09.2025 · 50 (3) · 1-36

DOI: 10.1145/3716376 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Database Systems, online erschienen am 14.05.2025. Verfasst von Chengliang Chai und 9 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 79 Literaturangaben. Gefördert von: National Key R&D Program of China, NSF of China, Shenzhen Project.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Given a dataset with incomplete data (e.g., missing values), training a machine learning model over the incomplete data requires two steps. First, it requires a data-effective step that cleans the data in order to improve the data quality (and the model quality on the cleaned data). Second, it requires a data-efficient step that selects a core subset of the data (called coreset) such that the trained models on the entire data and the coreset have similar model quality, in order to save the computational cost of training. The first-data-effective-then-data-efficient methods are too costly, because they are expensive to clean the whole data; while the first-data-efficient-then-data-effective methods have low model quality, because they cannot select high-quality coreset for incomplete data. In this article, we investigate the problem of coreset selection over incomplete data for data-effective and data-efficient machine learning. The essential challenge is how to model the incomplete data for selecting high-quality coreset. To this end, we propose the GoodCore framework towards selecting a good coreset over incomplete data with low cost. To model the unknown complete data, we utilize the combinations of possible repairs as possible worlds of the incomplete data. Based on possible worlds, GoodCore selects an expected optimal coreset through gradient approximation without training ML models. We formally define the expected optimal coreset selection problem, prove its NP-hardness, and propose a greedy algorithm with an approximation ratio. To make GoodCore more efficient, we propose optimization methods that incorporate human-in-the-loop imputation or automatic imputation method into our framework. Moreover, a group-based strategy is utilized to further accelerate the coreset selection with incomplete data given large datasets. Experimental results show the effectiveness and efficiency of our framework with low cost.

Förderung

  • National Key R&D Program of China
  • NSF of China
  • Shenzhen Project
  • Zhongguancun Lab, Huawei, and Beijing National Research Center for Information Science and Technology
  • National Key Research and Development Program of China
  • NSFC
  • CCF-Baidu Open Fund
  • Huawei

Zitieren

APA

Chai, C., Jin, K., Tang, N., Fan, J., Miao, D., Wang, J., Luo, Y., Li, G., Yuan, Y., & Wang, G. (2025). Cost-effective Missing Value Imputation for Data-effective Machine Learning. ACM Transactions on Database Systems, 50(3), 1-36. https://doi.org/10.1145/3716376

Vancouver

Chai C, Jin K, Tang N, Fan J, Miao D, Wang J, et al. Cost-effective Missing Value Imputation for Data-effective Machine Learning. ACM Transactions on Database Systems. 2025;50(3):1-36. doi:10.1145/3716376

BibTeX
@article{Chai2025,
  author = {Chai, Chengliang and Jin, Kaisen and Tang, Nan and Fan, Ju and Miao, Dongjing and Wang, Jiayi and Luo, Yuyu and Li, Guoliang and Yuan, Ye and Wang, Guoren},
  title = {Cost-effective Missing Value Imputation for Data-effective Machine Learning},
  journal = {ACM Transactions on Database Systems},
  year = {2025},
  volume = {50},
  number = {3},
  pages = {1--36},
  doi = {10.1145/3716376}
}
Kostenlos starten →