Reliable Multi-Modal Semantic Communication via AI-Oriented Residual Encoding
IEEE Wireless Communications Letters · 2026 · 15 · 2368-2372
DOI: 10.1109/lwc.2026.3676736 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Wireless Communications Letters, 2026. Verfasst von Jinhyuk Choi und 2 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 12 Literaturangaben. Gefördert von: Project from the Institute for Information and Communications Technology Promotion (IITP) grant funded by Korean Government [Ministry of Science and ICT (MSIT)], Smart Networks and Services Joint Undertaking (SNS JU) under European Union’s Horizon Europe Research and Innovation Program.
Abstract (Originalsprache)
This letter introduces a communication-efficient multi-modal semantic communication (MMSC) framework over wireless networks, termed Residual Hierarchical-Adaptive Modality Control (ReHi-AMC). Under an outage-based transmission without CSI feedback, ReHi-AMC preserves generative reconstruction quality. The framework assigns cross-modal transmission priorities and progressively encodes spatial sketches through a hierarchical multi-resolution representation. To further enhance payload efficiency, residual information between hierarchical levels is compressed via sparse residual encoding, reducing redundancy while maintaining essential structural cues. Numerical evaluations on a Stable Diffusion–based generative architecture demonstrate up to 46.47% improvement in CLIP score, with particularly pronounced gains in low-SNR regimes, confirming robustness against channel outages compared to single-scale baselines without residual encoding.
Förderung
- Project from the Institute for Information and Communications Technology Promotion (IITP) grant funded by Korean Government [Ministry of Science and ICT (MSIT)]
- Smart Networks and Services Joint Undertaking (SNS JU) under European Union’s Horizon Europe Research and Innovation Program
Zitieren
APA
Choi, J., Oh, S., & Kim, S. (2026). Reliable Multi-Modal Semantic Communication via AI-Oriented Residual Encoding. IEEE Wireless Communications Letters, 15, 2368-2372. https://doi.org/10.1109/lwc.2026.3676736
Vancouver
Choi J, Oh S, Kim S. Reliable Multi-Modal Semantic Communication via AI-Oriented Residual Encoding. IEEE Wireless Communications Letters. 2026;15:2368-2372. doi:10.1109/lwc.2026.3676736
BibTeX
@article{Choi2026,
author = {Choi, Jinhyuk and Oh, Seungeun and Kim, Seong-Lyun},
title = {Reliable Multi-Modal Semantic Communication via AI-Oriented Residual Encoding},
journal = {IEEE Wireless Communications Letters},
year = {2026},
volume = {15},
pages = {2368--2372},
doi = {10.1109/lwc.2026.3676736}
}
EUVIMED