Beyond Word-Based Model Embeddings: Contextualized Representations for Enhanced Social Media Spam Detection
Applied Sciences · 07.03.2024 · 14 (6) · 2254
DOI: 10.3390/app14062254 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 07.03.2024. Verfasst von Sawsan Alshattnawi und 3 weiteren Autor:innen. Die Arbeit wurde bisher 48-mal zitiert (Crossref) und nennt 55 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
As social media platforms continue their exponential growth, so do the threats targeting their security. Detecting disguised spam messages poses an immense challenge owing to the constant evolution of tactics. This research investigates advanced artificial intelligence techniques to significantly enhance multiplatform spam classification on Twitter and YouTube. The deep neural networks we use are state-of-the-art. They are recurrent neural network architectures with long- and short-term memory cells that are powered by both static and contextualized word embeddings. Extensive comparative experiments precede rigorous hyperparameter tuning on the datasets. Results reveal a profound impact of tailored, platform-specific AI techniques in combating sophisticated and perpetually evolving threats. The key innovation lies in tailoring deep learning (DL) architectures to leverage both intrinsic platform contexts and extrinsic contextual embeddings for strengthened generalization. The results include consistent accuracy improvements of more than 10–15% in multisource datasets, unlocking actionable guidelines on optimal components of neural models, and embedding strategies for cross-platform defense systems. Contextualized embeddings like BERT and ELMo consistently outperform their noncontextualized counterparts. The standalone ELMo model with logistic regression emerges as the top performer, attaining exceptional accuracy scores of 90% on Twitter and 94% on YouTube data. This signifies the immense potential of contextualized language representations in capturing subtle semantic signals vital for identifying disguised spam. As emerging adversarial attacks exploit human vulnerabilities, advancing defense strategies through enhanced neural language understanding is imperative. We recommend that social media companies and academic researchers build on contextualized language models to strengthen social media security. This research approach demonstrates the immense potential of personalized, platform-specific DL techniques to combat the continuously evolving threats that threaten social media security.
Zitieren
APA
Alshattnawi, S., Shatnawi, A., AlSobeh, A. M., & Magableh, A. A. (2024). Beyond Word-Based Model Embeddings: Contextualized Representations for Enhanced Social Media Spam Detection. Applied Sciences, 14(6), 2254. https://doi.org/10.3390/app14062254
Vancouver
Alshattnawi S, Shatnawi A, AlSobeh AM, Magableh AA. Beyond Word-Based Model Embeddings: Contextualized Representations for Enhanced Social Media Spam Detection. Applied Sciences. 2024;14(6):2254. doi:10.3390/app14062254
BibTeX
@article{Alshattnawi2024,
author = {Alshattnawi, Sawsan and Shatnawi, Amani and AlSobeh, Anas M.R. and Magableh, Aws A.},
title = {Beyond Word-Based Model Embeddings: Contextualized Representations for Enhanced Social Media Spam Detection},
journal = {Applied Sciences},
year = {2024},
volume = {14},
number = {6},
pages = {2254},
doi = {10.3390/app14062254}
}
EUVIMED