EUVIMEDOpdag EUVIMED
Open access · CC BY 4.0

Document-Level Transformer-Based Text Semantic Communication System

Asma Mahgoub, Elias Yaacoub

Machine Learning and Knowledge Extraction · 2026-08-03 · 8 (8) · 225

DOI: 10.3390/make8080225 ↗

At a glance

Journal article in Machine Learning and Knowledge Extraction, published online on 2026-08-03. Written by Asma Mahgoub and 1 co-authors. 34 references. The full text is freely available (open access, CC BY 4.0). Funded by: Qatar University.

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Given the emergence of new applications with stringent networking requirements, traditional bit-level communication may reach theoretical Shannon capacity and struggle to support such applications. Therefore, the idea of semantic communication (SC) has been proposed in literature. SC involves the use of artificial intelligence and a shared knowledge base to send a representation of data and reconstruct it at the receiver. In this paper, a SC system for document transmission is proposed. The system uses a transformer and a context encoder module to preserve the document’s knowledge and context information by quantifying the relationship between a current sentence and the preceding sentences. The semantic information is sent over a noisy channel, and a mutual information maximization model is used to reduce the effect of noise on the transmitted signal. The proposed system is trained in two stages; the first stage involves training the sentence-level transformers while the second stage involves training the sentence-level and the context-level transformers. The performance of the system is evaluated using two publicly available datasets. The results show that the performance of the proposed system is better than a sentence-level SC model in terms of BLEU score and sentence similarity over a Rayleigh fading channel.

Funding

  • Qatar University

Cite

APA

Mahgoub, A., & Yaacoub, E. (2026). Document-Level Transformer-Based Text Semantic Communication System. Machine Learning and Knowledge Extraction, 8(8), 225. https://doi.org/10.3390/make8080225

Vancouver

Mahgoub A, Yaacoub E. Document-Level Transformer-Based Text Semantic Communication System. Machine Learning and Knowledge Extraction. 2026;8(8):225. doi:10.3390/make8080225

BibTeX
@article{Mahgoub2026,
  author = {Mahgoub, Asma and Yaacoub, Elias},
  title = {Document-Level Transformer-Based Text Semantic Communication System},
  journal = {Machine Learning and Knowledge Extraction},
  year = {2026},
  volume = {8},
  number = {8},
  pages = {225},
  doi = {10.3390/make8080225}
}
Start for free →