Diffusion Reconstruction-based Data Likelihood Estimation for Core-Set Selection
Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (17) · 14556-14564
DOI: 10.1609/aaai.v40i17.38473 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Mingyang Chen und 5 weiteren Autor:innen.
Abstract (Originalsprache)
Existing core-set selection methods predominantly rely on heuristic scoring signals such as training dynamics or model uncertainty, lacking explicit modeling of data likelihood. This omission may hinder the constructed subset from capturing subtle yet critical distributional structures that underpin effective model training. In this work, we propose a novel, theoretically grounded approach that leverages diffusion models to estimate data likelihood via reconstruction deviation induced by partial reverse denoising. Specifically, we establish a formal connection between reconstruction error and data likelihood, grounded in the Evidence Lower Bound (ELBO) of Markovian diffusion processes, thereby enabling a principled, distribution-aware scoring criterion for data selection. Complementarily, we introduce an efficient information-theoretic method to identify the optimal reconstruction timestep, ensuring that the deviation provides a reliable signal indicative of underlying data likelihood. Extensive experiments on ImageNet demonstrate that reconstruction deviation offers an effective scoring criterion, consistently outperforming existing baselines across selection ratios, and closely matching full-data training using only 50% of the data. Further analysis shows that the likelihood-informed nature of our score reveals informative insights in data selection, shedding light on the interplay between data distributional characteristics and model learning preferences.
Zitieren
APA
Chen, M., Du, J., Huang, B., Wang, Y., Zhang, X., & Wang, W. (2026). Diffusion Reconstruction-based Data Likelihood Estimation for Core-Set Selection. Proceedings of the AAAI Conference on Artificial Intelligence, 40(17), 14556-14564. https://doi.org/10.1609/aaai.v40i17.38473
Vancouver
Chen M, Du J, Huang B, Wang Y, Zhang X, Wang W. Diffusion Reconstruction-based Data Likelihood Estimation for Core-Set Selection. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(17):14556-14564. doi:10.1609/aaai.v40i17.38473
BibTeX
@article{Chen2026,
author = {Chen, Mingyang and Du, Jiawei and Huang, Bo and Wang, Yi and Zhang, Xiaobo and Wang, Wei},
title = {Diffusion Reconstruction-based Data Likelihood Estimation for Core-Set Selection},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2026},
volume = {40},
number = {17},
pages = {14556--14564},
doi = {10.1609/aaai.v40i17.38473}
}
EUVIMED