EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Robust Sentiment Analysis Through Bayesian Dropout-Enhanced RoBERTa-LSTM

Soufien Jaffali

BRAIN. Broad Research in Artificial Intelligence and Neuroscience · 05.12.2025 · 16 (4) · 113

DOI: 10.70594/brain/16.4/7 ↗

Kurz gefasst

Fachartikel in der Zeitschrift BRAIN. Broad Research in Artificial Intelligence and Neuroscience, online erschienen am 05.12.2025. Verfasst von Soufien Jaffali. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Transformer models such as RoBERTa provide strong contextualised embeddings for sentiment analysis but lack inherent mechanisms to quantify predictive uncertainty and are prone to overfitting, particularly on noisy or imbalanced text data. This paper introduces RoBERTa-LSTM-Drop, a hybrid architecture that combines RoBERTa embeddings with bidirectional LSTM layers and integrates Bayesian Dropout to capture uncertainty through Monte Carlo sampling while acting as an effective regulariser. The model is evaluated on two complementary benchmark datasets: IMDb, representing long and structured reviews, and Sentiment140, representing short and informal tweets. Comparisons are made against traditional baselines such as Logistic Regression as well as a RoBERTa-LSTM without Bayesian Dropout. Results demonstrate that RoBERTa-LSTM-B.Drop achieves accuracy competitive with strong baselines while offering calibrated uncertainty estimates that enhance model reliability. The findings highlight a stability–performance trade-off: Bayesian Dropout can yield modest accuracy improvements but introduces variance across optimisers and learning rates. Practical mitigation strategies, including dropout-rate adjustment and gradient clipping, are discussed. Beyond raw performance, uncertainty estimates enable identification of low-confidence, error-prone predictions, supporting risk-aware deployment in real-world scenarios. The analysis further clarifies when uncertainty-aware hybrids are most advantageous—such as in longer, context-rich inputs—and where their gains are limited. The work contributes both an empirical study of uncertainty-aware sentiment analysis and reproducible design choices to inform future research.

Zitieren

APA

Jaffali, S. (2025). Robust Sentiment Analysis Through Bayesian Dropout-Enhanced RoBERTa-LSTM. BRAIN. Broad Research in Artificial Intelligence and Neuroscience, 16(4), 113. https://doi.org/10.70594/brain/16.4/7

Vancouver

Jaffali S. Robust Sentiment Analysis Through Bayesian Dropout-Enhanced RoBERTa-LSTM. BRAIN. Broad Research in Artificial Intelligence and Neuroscience. 2025;16(4):113. doi:10.70594/brain/16.4/7

BibTeX
@article{Jaffali2025,
  author = {Jaffali, Soufien},
  title = {Robust Sentiment Analysis Through Bayesian Dropout-Enhanced RoBERTa-LSTM},
  journal = {BRAIN. Broad Research in Artificial Intelligence and Neuroscience},
  year = {2025},
  volume = {16},
  number = {4},
  pages = {113},
  doi = {10.70594/brain/16.4/7}
}
Kostenlos starten →