EUVIMEDEUVIMED entdecken
Crossref

A Comparative Survey of Instance Selection Methods applied to Non-Neural and Transformer-Based Text Classification

Washington Cunha, Felipe Viegas, Celso França, Thierson Rosa, Leonardo Rocha, Marcos André Gonçalves

ACM Computing Surveys · 31.12.2023 · 55 (13s) · 1-52

DOI: 10.1145/3582000 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Computing Surveys, online erschienen am 13.07.2023. Verfasst von Washington Cunha und 5 weiteren Autor:innen. Die Arbeit wurde bisher 60-mal zitiert (Crossref) und nennt 83 Literaturangaben. Gefördert von: CNPq, CAPES, FAPEMIG.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Progress in natural language processing has been dictated by the rule of more : more data, more computing power, more complexity, best exemplified by deep learning Transformers. However, training (or fine-tuning) large dense models for specific applications usually requires significant amounts of computing resources. One way to ameliorate this problem is through data engineering instead of the algorithmic or hardware perspectives. Our focus here is an under-investigated data engineering technique, with enormous potential in the current scenario – Instance Selection (IS) (a.k.a. Selective Sampling, Prototype Selection). The IS goal is to reduce the training set size by removing noisy or redundant instances while maintaining or improving the effectiveness (accuracy) of the trained models and reducing the training process cost. We survey classical and recent state-of-the-art IS techniques and provide a scientifically sound comparison of IS methods applied to an essential natural language processing task—Automatic Text Classification (ATC). IS methods have been normally applied to small tabular datasets and have not been systematically compared in ATC. We consider several neural and non-neural state-of-the-art ATC solutions and many datasets. We answer several research questions based on tradeoffs induced by a tripod (training set reduction, effectiveness, and efficiency). Our answers reveal an enormous unfulfilled potential for IS solutions. Specially, we show that in 12 out of 19 datasets, specific IS methods—namely, Condensed Nearest Neighbor, Local Set-based Smoother, and Local Set Border Selector—can reduce the size of the training set without effectiveness losses. Furthermore, in the case of fine-tuning the Transformer methods, the IS methods reduce the amount of data needed, without losing effectiveness and with considerable training-time gains.

Förderung

  • CNPq
  • CAPES
  • FAPEMIG
  • Amazon Web Services
  • NVIDIA
  • Google Research Awards

Zitieren

APA

Cunha, W., Viegas, F., França, C., Rosa, T., Rocha, L., & Gonçalves, M. A. (2023). A Comparative Survey of Instance Selection Methods applied to Non-Neural and Transformer-Based Text Classification. ACM Computing Surveys, 55(13s), 1-52. https://doi.org/10.1145/3582000

Vancouver

Cunha W, Viegas F, França C, Rosa T, Rocha L, Gonçalves MA. A Comparative Survey of Instance Selection Methods applied to Non-Neural and Transformer-Based Text Classification. ACM Computing Surveys. 2023;55(13s):1-52. doi:10.1145/3582000

BibTeX
@article{Cunha2023,
  author = {Cunha, Washington and Viegas, Felipe and França, Celso and Rosa, Thierson and Rocha, Leonardo and Gonçalves, Marcos André},
  title = {A Comparative Survey of Instance Selection Methods applied to Non-Neural and Transformer-Based Text Classification},
  journal = {ACM Computing Surveys},
  year = {2023},
  volume = {55},
  number = {13s},
  pages = {1--52},
  doi = {10.1145/3582000}
}
Kostenlos starten →