Improving Learning-Based Semantic Coding Efficiency for Image Transmission via Shared Semantic-Aware Codebook
IEEE Transactions on Communications · 2025-02 · 73 (2) · 1217-1232
DOI: 10.1109/tcomm.2024.3450877 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Communications, 2025-02. Verfasst von Hongwei Zhang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 28-mal zitiert (Crossref) und nennt 49 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Higher Education Discipline Innovation Project, Fundamental Research Funds for the Central Universities of China, by the Hong Kong Research Grants Council under the Areas of Excellence scheme.
Abstract (Originalsprache)
Semantic communications have emerged as a new communication paradigm that extracts and transmits meaningful information relevant to receiver tasks. The trendy semantic coding framework, namely, learning-based joint source-channel coding (JSCC), lies on data-driven principles, with its efficacy depending on the employed neural networks (NNs). This paper introduces a codebook-assisted semantic coding method to improve JSCC performance for image transmission. Notably, a well-constructed codebook is employed to map each source image into a codeword, which subsequently provides shared prior information to assist semantic coding with general NN architectures. The main novelty is two-fold. First, we propose a general semantic-aware codebook construction method based on weighted data-semantic distance. In the case where the semantic information is characterized by discrete labels, this method is refined by encapsulating the labels into codeword indexes. Second, we derive a novel information-theoretic loss function via variational approximation for end-to-end training of the semantic encoder and decoder. This loss function includes a penalty term to mitigate redundancy in the received signals concerning codewords. Extensive experiments conducted over both additive noisy channels and fading channels validate the superior performance of the proposed method with even small-sized codebooks in both image reconstruction and classification accuracy.
Förderung
- National Natural Science Foundation of China
- Higher Education Discipline Innovation Project
- Fundamental Research Funds for the Central Universities of China, by the Hong Kong Research Grants Council under the Areas of Excellence scheme
- Major Key Project of PCL Department of Broadband Communication
Zitieren
APA
Zhang, H., Tao, M., Sun, Y., & Letaief, K. B. (2025). Improving Learning-Based Semantic Coding Efficiency for Image Transmission via Shared Semantic-Aware Codebook. IEEE Transactions on Communications, 73(2), 1217-1232. https://doi.org/10.1109/tcomm.2024.3450877
Vancouver
Zhang H, Tao M, Sun Y, Letaief KB. Improving Learning-Based Semantic Coding Efficiency for Image Transmission via Shared Semantic-Aware Codebook. IEEE Transactions on Communications. 2025;73(2):1217-1232. doi:10.1109/tcomm.2024.3450877
BibTeX
@article{Zhang2025,
author = {Zhang, Hongwei and Tao, Meixia and Sun, Yaping and Letaief, Khaled B.},
title = {Improving Learning-Based Semantic Coding Efficiency for Image Transmission via Shared Semantic-Aware Codebook},
journal = {IEEE Transactions on Communications},
year = {2025},
volume = {73},
number = {2},
pages = {1217--1232},
doi = {10.1109/tcomm.2024.3450877}
}
EUVIMED