EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Enhancing Abstractive Summarization with Extracted Knowledge Graphs and Multi-Source Transformers

Tong Chen, Xuewei Wang, Tianwei Yue, Xiaoyu Bai, Cindy X. Le, Wenping Wang

Applied Sciences · 30.06.2023 · 13 (13) · 7753

DOI: 10.3390/app13137753 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 30.06.2023. Verfasst von Tong Chen und 5 weiteren Autor:innen. Die Arbeit wurde bisher 27-mal zitiert (Crossref) und nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

As the popularity of large language models (LLMs) has risen over the course of the last year, led by GPT-3/4 and especially its productization as ChatGPT, we have witnessed the extensive application of LLMs to text summarization. However, LLMs do not intrinsically have the power to verify the correctness of the information they supply and generate. This research introduces a novel approach to abstractive summarization, aiming to address the limitations of LLMs in that they struggle to understand the truth. The proposed method leverages extracted knowledge graph information and structured semantics as a guide for summarization. Building upon BART, one of the state-of-the-art sequence-to-sequence pre-trained LLMs, multi-source transformer modules are developed as an encoder, which are capable of processing textual and graphical inputs. Decoding is performed based on this enriched encoding to enhance the summary quality. The Wiki-Sum dataset, derived from Wikipedia text dumps, is introduced for evaluation purposes. Comparative experiments with baseline models demonstrate the strengths of the proposed approach in generating informative and relevant summaries. We conclude by presenting our insights into utilizing LLMs with graph external information, which will become a powerful aid towards the goal of factually correct and verified LLMs.

Zitieren

APA

Chen, T., Wang, X., Yue, T., Bai, X., Le, C. X., & Wang, W. (2023). Enhancing Abstractive Summarization with Extracted Knowledge Graphs and Multi-Source Transformers. Applied Sciences, 13(13), 7753. https://doi.org/10.3390/app13137753

Vancouver

Chen T, Wang X, Yue T, Bai X, Le CX, Wang W. Enhancing Abstractive Summarization with Extracted Knowledge Graphs and Multi-Source Transformers. Applied Sciences. 2023;13(13):7753. doi:10.3390/app13137753

BibTeX
@article{Chen2023,
  author = {Chen, Tong and Wang, Xuewei and Yue, Tianwei and Bai, Xiaoyu and Le, Cindy X. and Wang, Wenping},
  title = {Enhancing Abstractive Summarization with Extracted Knowledge Graphs and Multi-Source Transformers},
  journal = {Applied Sciences},
  year = {2023},
  volume = {13},
  number = {13},
  pages = {7753},
  doi = {10.3390/app13137753}
}
Kostenlos starten →