Unsupervised extractive multi-document summarization method based on transfer learning from BERT multi-task fine-tuning
Journal of Information Science · 2023-02 · 49 (1) · 164-182
DOI: 10.1177/0165551521990616 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Information Science, online erschienen am 15.02.2021. Verfasst von Salima Lamsiyah und 3 weiteren Autor:innen. Die Arbeit wurde bisher 47-mal zitiert (Crossref) und nennt 74 Literaturangaben.
Abstract (Originalsprache)
Text representation is a fundamental cornerstone that impacts the effectiveness of several text summarization methods. Transfer learning using pre-trained word embedding models has shown promising results. However, most of these representations do not consider the order and the semantic relationships between words in a sentence, and thus they do not carry the meaning of a full sentence. To overcome this issue, the current study proposes an unsupervised method for extractive multi-document summarization based on transfer learning from BERT sentence embedding model. Moreover, to improve sentence representation learning, we fine-tune BERT model on supervised intermediate tasks from GLUE benchmark datasets using single-task and multi-task fine-tuning methods. Experiments are performed on the standard DUC’2002–2004 datasets. The obtained results show that our method has significantly outperformed several baseline methods and achieves a comparable and sometimes better performance than the recent state-of-the-art deep learning–based methods. Furthermore, the results show that fine-tuning BERT using multi-task learning has considerably improved the performance.
Zitieren
APA
Lamsiyah, S., Mahdaouy, A. E., Ouatik, S. E. A., & Espinasse, B. (2023). Unsupervised extractive multi-document summarization method based on transfer learning from BERT multi-task fine-tuning. Journal of Information Science, 49(1), 164-182. https://doi.org/10.1177/0165551521990616
Vancouver
Lamsiyah S, Mahdaouy AE, Ouatik SEA, Espinasse B. Unsupervised extractive multi-document summarization method based on transfer learning from BERT multi-task fine-tuning. Journal of Information Science. 2023;49(1):164-182. doi:10.1177/0165551521990616
BibTeX
@article{Lamsiyah2023,
author = {Lamsiyah, Salima and Mahdaouy, Abdelkader El and Ouatik, Saïd El Alaoui and Espinasse, Bernard},
title = {Unsupervised extractive multi-document summarization method based on transfer learning from BERT multi-task fine-tuning},
journal = {Journal of Information Science},
year = {2023},
volume = {49},
number = {1},
pages = {164--182},
doi = {10.1177/0165551521990616}
}
EUVIMED