The Effect of Training Data Size on Disaster Classification from Twitter
Information · 08.07.2024 · 15 (7) · 393
DOI: 10.3390/info15070393 ↗Kurz gefasst
Fachartikel in der Zeitschrift Information, online erschienen am 08.07.2024. Verfasst von Dimitrios Effrosynidis und 2 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: European Union’s Horizon 2020 European Green Deal Research and Innovation Program.
Abstract (Originalsprache)
In the realm of disaster-related tweet classification, this study presents a comprehensive analysis of various machine learning algorithms, shedding light on crucial factors influencing algorithm performance. The exceptional efficacy of simpler models is attributed to the quality and size of the dataset, enabling them to discern meaningful patterns. While powerful, complex models are time-consuming and prone to overfitting, particularly with smaller or noisier datasets. Hyperparameter tuning, notably through Bayesian optimization, emerges as a pivotal tool for enhancing the performance of simpler models. A practical guideline for algorithm selection based on dataset size is proposed, consisting of Bernoulli Naive Bayes for datasets below 5000 tweets and Logistic Regression for larger datasets exceeding 5000 tweets. Notably, Logistic Regression shines with 20,000 tweets, delivering an impressive combination of performance, speed, and interpretability. A further improvement of 0.5% is achieved by applying ensemble and stacking methods.
Förderung
- European Union’s Horizon 2020 European Green Deal Research and Innovation Program
Zitieren
APA
Effrosynidis, D., Sylaios, G., & Arampatzis, A. (2024). The Effect of Training Data Size on Disaster Classification from Twitter. Information, 15(7), 393. https://doi.org/10.3390/info15070393
Vancouver
Effrosynidis D, Sylaios G, Arampatzis A. The Effect of Training Data Size on Disaster Classification from Twitter. Information. 2024;15(7):393. doi:10.3390/info15070393
BibTeX
@article{Effrosynidis2024,
author = {Effrosynidis, Dimitrios and Sylaios, Georgios and Arampatzis, Avi},
title = {The Effect of Training Data Size on Disaster Classification from Twitter},
journal = {Information},
year = {2024},
volume = {15},
number = {7},
pages = {393},
doi = {10.3390/info15070393}
}
EUVIMED