Quality over Quantity: Boosting Data Efficiency Through Ensembled Multimodal Data Curation
Proceedings of the AAAI Conference on Artificial Intelligence · 11.04.2025 · 39 (20) · 21761-21769
DOI: 10.1609/aaai.v39i20.35481 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 11.04.2025. Verfasst von Jinda Xu und 6 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref).
Abstract (Originalsprache)
In an era overwhelmed by vast amounts of data, the effective curation of web-crawl datasets is essential for optimizing model performance. This paper tackles the challenges associated with the unstructured and heterogeneous nature of such datasets. Traditional heuristic curation methods often inadequately capture complex features, resulting in biases and the exclusion of relevant data. We introduce an advanced, learning-driven approach, Ensemble Curation Of DAta ThroUgh Multimodal Operators, called EcoDatum, which employs a novel quality-guided deduplication method to balance feature distribution. EcoDatum strategically integrates various unimodal and multimodal data curation operators within a weak supervision ensemble framework, utilizing automated optimization to effectively score each data point. EcoDatum, which significantly improves the data curation quality and efficiency, outperforms existing state-of-the-art (SOTA) techniques, ranking 1st on the DataComp leaderboard with an average performance score of 0.182 across 38 diverse evaluation datasets. This represents a 28% improvement over the DataComp baseline method, demonstrating its effectiveness in improving dataset curation and model training efficiency.
Zitieren
APA
Xu, J., Song, Y., Wang, D., Zhao, W., Chen, M., Chen, K., & Li, Q. (2025). Quality over Quantity: Boosting Data Efficiency Through Ensembled Multimodal Data Curation. Proceedings of the AAAI Conference on Artificial Intelligence, 39(20), 21761-21769. https://doi.org/10.1609/aaai.v39i20.35481
Vancouver
Xu J, Song Y, Wang D, Zhao W, Chen M, Chen K, et al. Quality over Quantity: Boosting Data Efficiency Through Ensembled Multimodal Data Curation. Proceedings of the AAAI Conference on Artificial Intelligence. 2025;39(20):21761-21769. doi:10.1609/aaai.v39i20.35481
BibTeX
@article{Xu2025,
author = {Xu, Jinda and Song, Yuhao and Wang, Daming and Zhao, Weiwei and Chen, Minghua and Chen, Kangliang and Li, Qinya},
title = {Quality over Quantity: Boosting Data Efficiency Through Ensembled Multimodal Data Curation},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2025},
volume = {39},
number = {20},
pages = {21761--21769},
doi = {10.1609/aaai.v39i20.35481}
}
EUVIMED