Deep Learning-Based Short Text Summarization: An Integrated BERT and Transformer Encoder–Decoder Approach
Computation · 12.04.2025 · 13 (4) · 96
DOI: 10.3390/computation13040096 ↗Kurz gefasst
Fachartikel in der Zeitschrift Computation, online erschienen am 12.04.2025. Verfasst von Fahd A. Ghanem und 3 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 53 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
The field of text summarization has evolved from basic extractive methods that identify key sentences to sophisticated abstractive techniques that generate contextually meaningful summaries. In today’s digital landscape, where an immense volume of textual data is produced every day, the need for concise and coherent summaries is more crucial than ever. However, summarizing short texts, particularly from platforms like Twitter, presents unique challenges due to character constraints, informal language, and noise from elements such as hashtags, mentions, and URLs. To overcome these challenges, this paper introduces a deep learning framework for automated short text summarization on Twitter. The proposed approach combines bidirectional encoder representations from transformers (BERT) with a transformer-based encoder–decoder architecture (TEDA), incorporating an attention mechanism to improve contextual understanding. Additionally, long short-term memory (LSTM) networks are integrated within BERT to effectively capture long-range dependencies in tweets and their summaries. This hybrid model ensures that generated summaries remain informative, concise, and contextually relevant while minimizing redundancy. The performance of the proposed framework was assessed using three benchmark Twitter datasets—Hagupit, SHShoot, and Hyderabad Blast—with ROUGE scores serving as the evaluation metric. Experimental results demonstrate that the model surpasses existing approaches in accurately capturing key information from tweets. These findings underscore the framework’s effectiveness in automated short text summarization, offering a robust solution for efficiently processing and summarizing large-scale social media content.
Zitieren
APA
Ghanem, F. A., Padma, M. C., Abdulwahab, H. M., & Alkhatib, R. (2025). Deep Learning-Based Short Text Summarization: An Integrated BERT and Transformer Encoder–Decoder Approach. Computation, 13(4), 96. https://doi.org/10.3390/computation13040096
Vancouver
Ghanem FA, Padma MC, Abdulwahab HM, Alkhatib R. Deep Learning-Based Short Text Summarization: An Integrated BERT and Transformer Encoder–Decoder Approach. Computation. 2025;13(4):96. doi:10.3390/computation13040096
BibTeX
@article{Ghanem2025,
author = {Ghanem, Fahd A. and Padma, M. C. and Abdulwahab, Hudhaifa M. and Alkhatib, Ramez},
title = {Deep Learning-Based Short Text Summarization: An Integrated BERT and Transformer Encoder–Decoder Approach},
journal = {Computation},
year = {2025},
volume = {13},
number = {4},
pages = {96},
doi = {10.3390/computation13040096}
}
EUVIMED