EUVIMEDEUVIMED entdecken
Crossref

Task-Oriented Multimodal Semantic Communication Based on Double Channel State Estimation

Fei Yu, Zhe Xiang, Yanhao Wang, Nan Che, Yuandi Li, Yaguan Qian, Fuhui Zhou, Zhiguo Wan

IEEE Transactions on Mobile Computing · 2026-12 · 25 (12) · 23284-23297

DOI: 10.1109/tmc.2026.3725238 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Mobile Computing, 2026-12. Verfasst von Fei Yu und 7 weiteren Autor:innen. Die Arbeit nennt 44 Literaturangaben. Gefördert von: Liaoning Provincial Natural Science Foundation General Program, Doctoral Research Start-up Foundation of Liaoning University of Technology, National Science Foundation for Young Scientists of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multimodal Semantic Communication (MSC) has emerged as a novel communication paradigm. Although MSC has great potential to improve communication efficiency and reliability by integrating heterogeneous data modalities, including text, images, and audio, existing MSC methods often assume perfect Channel State Information (CSI) and static channel conditions, severely limiting their applicability in highly dynamic real-world environments. Furthermore, they still primarily address single-modal tasks and lack robust mechanisms for handling complex multimodal tasks, such as audio-visual event localization over streaming data. These limitations hinder their ability to meet the requirements of task-specific applications in diverse scenarios. To address these challenges, we propose a task-oriented MSC framework with double channel state estimation tailored for audio-visual event localization. The framework leverages digital pilot codes and channel modules to track and adjust the state of analog channels under varying channel conditions and employs Euler-based multimodal semantic encoding and decoding that account for time-frequency characteristics based on the dynamic channel state. Extensive experimental results demonstrate that the proposed framework outperforms several baseline methods in terms of event localization accuracy at the same Signal-to-Noise Ratio (SNR), highlighting its advantage in semantic communication quality.

Förderung

  • Liaoning Provincial Natural Science Foundation General Program
  • Doctoral Research Start-up Foundation of Liaoning University of Technology
  • National Science Foundation for Young Scientists of China

Zitieren

APA

Yu, F., Xiang, Z., Wang, Y., Che, N., Li, Y., Qian, Y., Zhou, F., & Wan, Z. (2026). Task-Oriented Multimodal Semantic Communication Based on Double Channel State Estimation. IEEE Transactions on Mobile Computing, 25(12), 23284-23297. https://doi.org/10.1109/tmc.2026.3725238

Vancouver

Yu F, Xiang Z, Wang Y, Che N, Li Y, Qian Y, et al. Task-Oriented Multimodal Semantic Communication Based on Double Channel State Estimation. IEEE Transactions on Mobile Computing. 2026;25(12):23284-23297. doi:10.1109/tmc.2026.3725238

BibTeX
@article{Yu2026,
  author = {Yu, Fei and Xiang, Zhe and Wang, Yanhao and Che, Nan and Li, Yuandi and Qian, Yaguan and Zhou, Fuhui and Wan, Zhiguo},
  title = {Task-Oriented Multimodal Semantic Communication Based on Double Channel State Estimation},
  journal = {IEEE Transactions on Mobile Computing},
  year = {2026},
  volume = {25},
  number = {12},
  pages = {23284--23297},
  doi = {10.1109/tmc.2026.3725238}
}
Kostenlos starten →