EUVIMEDEUVIMED entdecken
Crossref

Semantic Communications With World Models

Peiwen Jiang, Jiajia Guo, Chao-Kai Wen, Shi Jin, Jun Zhang

IEEE Transactions on Communications · 2026 · 74 · 11613-11627

DOI: 10.1109/tcomm.2026.3714287 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Communications, 2026. Verfasst von Peiwen Jiang und 4 weiteren Autor:innen. Die Arbeit nennt 43 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Key Technologies R&D Program of Jiangsu, Hong Kong Research Grants Council under the Areas of Excellence scheme.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Semantic communication is a promising technique for emerging wireless applications, which reduces transmission overhead by transmitting only task-relevant features instead of raw data. However, existing methods struggle under extremely low bandwidth and varying channel conditions, where corrupted or missing semantics lead to severe reconstruction errors. To resolve this difficulty, we propose a world foundation model (WFM)-aided semantic video transmission framework that leverages the predictive capability of WFMs to generate future frames based on the current frame and textual guidance. This design allows transmissions to be omitted when predictions remain reliable, thereby saving bandwidth. Through WFM’s prediction, the key semantics are preserved, yet minor prediction errors tend to amplify over time. To mitigate issue, a lightweight depth-based feedback module is introduced to determine whether transmission of the current frame is needed. Apart from transmitting the entire frame, a segmentation-assisted partial transmission method is proposed to repair degraded frames, which can further balance performance and bandwidth cost. Furthermore, an active transmission strategy is developed for mobile scenarios by exploiting camera trajectory information and proactively scheduling transmissions before channel quality deteriorates. Simulation results show that the proposed framework significantly reduces transmission overhead while maintaining task performances across varying scenarios and channel conditions.

Förderung

  • National Natural Science Foundation of China
  • Key Technologies R&D Program of Jiangsu
  • Hong Kong Research Grants Council under the Areas of Excellence scheme
  • Collaborative Research Scheme
  • Guangdong Basic and Applied Basic Research Foundation
  • National Science and Technology Council

Zitieren

APA

Jiang, P., Guo, J., Wen, C., Jin, S., & Zhang, J. (2026). Semantic Communications With World Models. IEEE Transactions on Communications, 74, 11613-11627. https://doi.org/10.1109/tcomm.2026.3714287

Vancouver

Jiang P, Guo J, Wen C, Jin S, Zhang J. Semantic Communications With World Models. IEEE Transactions on Communications. 2026;74:11613-11627. doi:10.1109/tcomm.2026.3714287

BibTeX
@article{Jiang2026,
  author = {Jiang, Peiwen and Guo, Jiajia and Wen, Chao-Kai and Jin, Shi and Zhang, Jun},
  title = {Semantic Communications With World Models},
  journal = {IEEE Transactions on Communications},
  year = {2026},
  volume = {74},
  pages = {11613--11627},
  doi = {10.1109/tcomm.2026.3714287}
}
Kostenlos starten →