EUVIMEDOpdag EUVIMED
Crossref

A Noise-Oriented and Redundancy-Aware Instance Selection Framework

Washington Cunha, Alejandro Moreo Fernández, Andrea Esuli, Fabrizio Sebastiani, Leonardo Rocha, Marcos André Gonçalves

ACM Transactions on Information Systems · 2025-03-31 · 43 (2) · 1-33

DOI: 10.1145/3705000 ↗

At a glance

Journal article in ACM Transactions on Information Systems, published online on 2025-01-17. Written by Washington Cunha and 5 co-authors. Cited 32 times so far (Crossref); 69 references. Funded by: CNPq, CAPES, FAPEMIG.

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Fine-tuning transformer-based deep-learning models are currently at the forefront of natural language processing (NLP) and information retrieval (IR) tasks. However, fine-tuning these transformers for specific tasks, especially when dealing with ever-expanding volumes of data, constant retraining requirements, and budget constraints, can be computationally and financially costly, requiring substantial energy consumption and contributing to carbon dioxide emissions. This article focuses on advancing the state-of-the-art (SOTA) on instance selection (IS)—a range of document filtering techniques designed to select the most representative documents for the sake of training. The objective is to either maintain or enhance classification effectiveness while reducing the overall training (fine-tuning) total processing time. In our prior research, we introduced the E2SC framework, a redundancy-oriented IS method focused on transformers and large datasets—currently the state-of-the-art in IS. Nonetheless, important research questions remained unanswered in our previous work, mostly due to E2SC’s sole emphasis on redundancy. In this article, we take our research a step further by proposing biO-IS— an extended bi - o bjective i nstance s election solution, a novel IS framework aimed at simultaneously removing redundant and noisy instances from the training. biO-IS estimates redundancy based on scalable, fast, and calibrated weak classifiers and captures noise with the support of a new entropy-based step. We also propose a novel iterative process to estimate near-optimum reduction rates for both steps. Our extended solution is able to reduce the training sets by 41% on average (up to 60%) while maintaining the effectiveness in all tested datasets, with speedup gains of 1.67 on average (up to 2.46x). No other baseline, not even our previous SOTA solution, was capable of achieving results with this level of quality, considering the tradeoff among training reduction, effectiveness, and speedup. To ensure reproducibility, our documentation, code, and datasets can be accessed on GitHub— https://github.com/waashk/bio-is .

Funding

  • CNPq
  • CAPES
  • FAPEMIG
  • AWS
  • NVIDIA
  • CIIA-Saúde
  • FAPESP
  • Italian Ministry of University and Research

Cite

APA

Cunha, W., Fernández, A. M., Esuli, A., Sebastiani, F., Rocha, L., & Gonçalves, M. A. (2025). A Noise-Oriented and Redundancy-Aware Instance Selection Framework. ACM Transactions on Information Systems, 43(2), 1-33. https://doi.org/10.1145/3705000

Vancouver

Cunha W, Fernández AM, Esuli A, Sebastiani F, Rocha L, Gonçalves MA. A Noise-Oriented and Redundancy-Aware Instance Selection Framework. ACM Transactions on Information Systems. 2025;43(2):1-33. doi:10.1145/3705000

BibTeX
@article{Cunha2025,
  author = {Cunha, Washington and Fernández, Alejandro Moreo and Esuli, Andrea and Sebastiani, Fabrizio and Rocha, Leonardo and Gonçalves, Marcos André},
  title = {A Noise-Oriented and Redundancy-Aware Instance Selection Framework},
  journal = {ACM Transactions on Information Systems},
  year = {2025},
  volume = {43},
  number = {2},
  pages = {1--33},
  doi = {10.1145/3705000}
}
Start for free →