Task-Oriented Multimodal Semantic Communication Based on Double Channel State Estimation
IEEE Transactions on Mobile Computing · 2026-12 · 25 (12) · 23284-23297
DOI: 10.1109/tmc.2026.3725238 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Mobile Computing, 2026-12. Verfasst von Fei Yu und 7 weiteren Autor:innen. Die Arbeit nennt 44 Literaturangaben. Gefördert von: Liaoning Provincial Natural Science Foundation General Program, Doctoral Research Start-up Foundation of Liaoning University of Technology, National Science Foundation for Young Scientists of China.
Abstract (Originalsprache)
Multimodal Semantic Communication (MSC) has emerged as a novel communication paradigm. Although MSC has great potential to improve communication efficiency and reliability by integrating heterogeneous data modalities, including text, images, and audio, existing MSC methods often assume perfect Channel State Information (CSI) and static channel conditions, severely limiting their applicability in highly dynamic real-world environments. Furthermore, they still primarily address single-modal tasks and lack robust mechanisms for handling complex multimodal tasks, such as audio-visual event localization over streaming data. These limitations hinder their ability to meet the requirements of task-specific applications in diverse scenarios. To address these challenges, we propose a task-oriented MSC framework with double channel state estimation tailored for audio-visual event localization. The framework leverages digital pilot codes and channel modules to track and adjust the state of analog channels under varying channel conditions and employs Euler-based multimodal semantic encoding and decoding that account for time-frequency characteristics based on the dynamic channel state. Extensive experimental results demonstrate that the proposed framework outperforms several baseline methods in terms of event localization accuracy at the same Signal-to-Noise Ratio (SNR), highlighting its advantage in semantic communication quality.
Förderung
- Liaoning Provincial Natural Science Foundation General Program
- Doctoral Research Start-up Foundation of Liaoning University of Technology
- National Science Foundation for Young Scientists of China
Zitieren
APA
Yu, F., Xiang, Z., Wang, Y., Che, N., Li, Y., Qian, Y., Zhou, F., & Wan, Z. (2026). Task-Oriented Multimodal Semantic Communication Based on Double Channel State Estimation. IEEE Transactions on Mobile Computing, 25(12), 23284-23297. https://doi.org/10.1109/tmc.2026.3725238
Vancouver
Yu F, Xiang Z, Wang Y, Che N, Li Y, Qian Y, et al. Task-Oriented Multimodal Semantic Communication Based on Double Channel State Estimation. IEEE Transactions on Mobile Computing. 2026;25(12):23284-23297. doi:10.1109/tmc.2026.3725238
BibTeX
@article{Yu2026,
author = {Yu, Fei and Xiang, Zhe and Wang, Yanhao and Che, Nan and Li, Yuandi and Qian, Yaguan and Zhou, Fuhui and Wan, Zhiguo},
title = {Task-Oriented Multimodal Semantic Communication Based on Double Channel State Estimation},
journal = {IEEE Transactions on Mobile Computing},
year = {2026},
volume = {25},
number = {12},
pages = {23284--23297},
doi = {10.1109/tmc.2026.3725238}
}
EUVIMED