EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Document-Level Transformer-Based Text Semantic Communication System

Asma Mahgoub, Elias Yaacoub

Machine Learning and Knowledge Extraction · 03.08.2026 · 8 (8) · 225

DOI: 10.3390/make8080225 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Machine Learning and Knowledge Extraction, online erschienen am 03.08.2026. Verfasst von Asma Mahgoub und 1 weiteren Autor:innen. Die Arbeit nennt 34 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Qatar University.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Given the emergence of new applications with stringent networking requirements, traditional bit-level communication may reach theoretical Shannon capacity and struggle to support such applications. Therefore, the idea of semantic communication (SC) has been proposed in literature. SC involves the use of artificial intelligence and a shared knowledge base to send a representation of data and reconstruct it at the receiver. In this paper, a SC system for document transmission is proposed. The system uses a transformer and a context encoder module to preserve the document’s knowledge and context information by quantifying the relationship between a current sentence and the preceding sentences. The semantic information is sent over a noisy channel, and a mutual information maximization model is used to reduce the effect of noise on the transmitted signal. The proposed system is trained in two stages; the first stage involves training the sentence-level transformers while the second stage involves training the sentence-level and the context-level transformers. The performance of the system is evaluated using two publicly available datasets. The results show that the performance of the proposed system is better than a sentence-level SC model in terms of BLEU score and sentence similarity over a Rayleigh fading channel.

Förderung

  • Qatar University

Zitieren

APA

Mahgoub, A., & Yaacoub, E. (2026). Document-Level Transformer-Based Text Semantic Communication System. Machine Learning and Knowledge Extraction, 8(8), 225. https://doi.org/10.3390/make8080225

Vancouver

Mahgoub A, Yaacoub E. Document-Level Transformer-Based Text Semantic Communication System. Machine Learning and Knowledge Extraction. 2026;8(8):225. doi:10.3390/make8080225

BibTeX
@article{Mahgoub2026,
  author = {Mahgoub, Asma and Yaacoub, Elias},
  title = {Document-Level Transformer-Based Text Semantic Communication System},
  journal = {Machine Learning and Knowledge Extraction},
  year = {2026},
  volume = {8},
  number = {8},
  pages = {225},
  doi = {10.3390/make8080225}
}
Kostenlos starten →