EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Quality over Quantity: An Effective Large-Scale Data Reduction Strategy Based on Pointwise V-Information

Fei Chen, Wenchi Zhou

Electronics · 01.08.2025 · 14 (15) · 3092

DOI: 10.3390/electronics14153092 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 01.08.2025. Verfasst von Fei Chen und 1 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Educational Department of Liaoning Province.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In order to increase the effectiveness of model training, data reduction is essential to data-centric Artificial Intelligence (AI). It achieves this by locating the most instructive examples in massive datasets. To increase data quality and training efficiency, the main difficulty is choosing the best examples rather than the complete datasets. In this paper, we propose an effective data reduction strategy based on Pointwise V-Information (PVI). To enable a static method, we first use PVI to quantify instance difficulty and remove instances with low difficulty. Experiments show that classifier performance is maintained with only a 0.0001% to 0.76% decline in accuracy when 10–30% of the data is removed. Second, we train the classifiers using a progressive learning strategy on examples sorted by increasing PVI, accelerating convergence and achieving a 0.8% accuracy gain over conventional training. Our findings imply that training a classifier on the chosen optimal subset may improve model performance and increase training efficiency when combined with an efficient data reduction strategy. Furthermore, we have adapted the PVI framework, which was previously limited to English datasets, to a variety of Chinese Natural Language Processing (NLP) tasks and base models, yielding insightful results for faster training and cross-lingual data reduction.

Förderung

  • Educational Department of Liaoning Province

Zitieren

APA

Chen, F., & Zhou, W. (2025). Quality over Quantity: An Effective Large-Scale Data Reduction Strategy Based on Pointwise V-Information. Electronics, 14(15), 3092. https://doi.org/10.3390/electronics14153092

Vancouver

Chen F, Zhou W. Quality over Quantity: An Effective Large-Scale Data Reduction Strategy Based on Pointwise V-Information. Electronics. 2025;14(15):3092. doi:10.3390/electronics14153092

BibTeX
@article{Chen2025,
  author = {Chen, Fei and Zhou, Wenchi},
  title = {Quality over Quantity: An Effective Large-Scale Data Reduction Strategy Based on Pointwise V-Information},
  journal = {Electronics},
  year = {2025},
  volume = {14},
  number = {15},
  pages = {3092},
  doi = {10.3390/electronics14153092}
}
Kostenlos starten →