EUVIMEDEUVIMED entdecken
Crossref

Unsupervised extractive multi-document summarization method based on transfer learning from BERT multi-task fine-tuning

Salima Lamsiyah, Abdelkader El Mahdaouy, Saïd El Alaoui Ouatik, Bernard Espinasse

Journal of Information Science · 2023-02 · 49 (1) · 164-182

DOI: 10.1177/0165551521990616 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Information Science, online erschienen am 15.02.2021. Verfasst von Salima Lamsiyah und 3 weiteren Autor:innen. Die Arbeit wurde bisher 47-mal zitiert (Crossref) und nennt 74 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Text representation is a fundamental cornerstone that impacts the effectiveness of several text summarization methods. Transfer learning using pre-trained word embedding models has shown promising results. However, most of these representations do not consider the order and the semantic relationships between words in a sentence, and thus they do not carry the meaning of a full sentence. To overcome this issue, the current study proposes an unsupervised method for extractive multi-document summarization based on transfer learning from BERT sentence embedding model. Moreover, to improve sentence representation learning, we fine-tune BERT model on supervised intermediate tasks from GLUE benchmark datasets using single-task and multi-task fine-tuning methods. Experiments are performed on the standard DUC’2002–2004 datasets. The obtained results show that our method has significantly outperformed several baseline methods and achieves a comparable and sometimes better performance than the recent state-of-the-art deep learning–based methods. Furthermore, the results show that fine-tuning BERT using multi-task learning has considerably improved the performance.

Zitieren

APA

Lamsiyah, S., Mahdaouy, A. E., Ouatik, S. E. A., & Espinasse, B. (2023). Unsupervised extractive multi-document summarization method based on transfer learning from BERT multi-task fine-tuning. Journal of Information Science, 49(1), 164-182. https://doi.org/10.1177/0165551521990616

Vancouver

Lamsiyah S, Mahdaouy AE, Ouatik SEA, Espinasse B. Unsupervised extractive multi-document summarization method based on transfer learning from BERT multi-task fine-tuning. Journal of Information Science. 2023;49(1):164-182. doi:10.1177/0165551521990616

BibTeX
@article{Lamsiyah2023,
  author = {Lamsiyah, Salima and Mahdaouy, Abdelkader El and Ouatik, Saïd El Alaoui and Espinasse, Bernard},
  title = {Unsupervised extractive multi-document summarization method based on transfer learning from BERT multi-task fine-tuning},
  journal = {Journal of Information Science},
  year = {2023},
  volume = {49},
  number = {1},
  pages = {164--182},
  doi = {10.1177/0165551521990616}
}
Kostenlos starten →