EUVIMEDEUVIMED entdecken
Crossref

Intelligent Multi-Modal Sensing-Communication Integration: Synesthesia of Machines

Xiang Cheng, Haotian Zhang, Jianan Zhang, Shijian Gao, Sijiang Li, Ziwei Huang, Lu Bai, Zonghui Yang, Xinhu Zheng, Liuqing Yang

IEEE Communications Surveys & Tutorials · 2024 · 26 (1) · 258-301

DOI: 10.1109/comst.2023.3336917 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Communications Surveys & Tutorials, 2024. Verfasst von Xiang Cheng und 9 weiteren Autor:innen. Die Arbeit wurde bisher 146-mal zitiert (Crossref) und nennt 221 Literaturangaben. Gefördert von: Ministry National Key Research and Development Project, National Natural Science Foundation of China, New Cornerstone Science Foundation through the XPLORER PRIZE.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In the era of sixth-generation (6G) wireless communications, integrated sensing and communications (ISAC) is recognized as a promising solution to upgrade the physical system by endowing wireless communications with sensing capability. Existing ISAC is mainly oriented to static scenarios with radio-frequency (RF) sensors being the primary participants, thus lacking a comprehensive environment feature characterization and facing a severe performance bottleneck in dynamic environments. To date, extensive surveys on ISAC have been conducted but are limited to summarizing RF-based radar sensing. Currently, some research efforts have been devoted to exploring multi-modal sensing-communication integration but still lack a comprehensive review. To fill the gap, we embark on an initial endeavor with the goal of establishing a unified framework of intelligent multi-modal sensing-communication integration by generalizing the concept of ISAC and providing a comprehensive review under this framework. Inspired by the human synesthesia, the so-termed Synesthesia of Machines (SoM) gives the clearest cognition of such an intelligent integration and details its paradigm for the first time. We commence by justifying the necessity and potential of the new paradigm. Subsequently, we offer a rigorous definition of SoM and zoom into the detailed paradigm, which is summarized as three operational modes realizing the integration. To facilitate SoM research, we overview the prerequisite of SoM research, that is, mixed multi-modal (MMM) datasets, and introduce our work. Built upon the MMM datasets, we introduce the mapping relationships between multi-modal sensing and communications, and discuss how channel modeling can be customized to support the exploration of such relationships. Afterward, aiming at giving a comprehensive survey on the current research status of multi-modal sensing-communication integration, we cover the technological review on SoM-enhance-based and SoM-concert-based applications in transceiver design and environment sensing. To corroborate the rationality and superiority of SoM, we also present simulation results related to dual-function waveform and predictive beamforming design tailored for dynamic scenarios. Finally, we propose some open issues and potential directions to inspire future research efforts on SoM.

Förderung

  • Ministry National Key Research and Development Project
  • National Natural Science Foundation of China
  • New Cornerstone Science Foundation through the XPLORER PRIZE
  • Shandong Natural Science Foundation
  • Young Elite Scientists Sponsorship Program by CAST
  • Taishan Scholars Program
  • Guangzhou Municipal Science and Technology Project
  • Guangdong Provincial Department of Education Major Research Project

Zitieren

APA

Cheng, X., Zhang, H., Zhang, J., Gao, S., Li, S., Huang, Z., Bai, L., Yang, Z., Zheng, X., & Yang, L. (2024). Intelligent Multi-Modal Sensing-Communication Integration: Synesthesia of Machines. IEEE Communications Surveys & Tutorials, 26(1), 258-301. https://doi.org/10.1109/comst.2023.3336917

Vancouver

Cheng X, Zhang H, Zhang J, Gao S, Li S, Huang Z, et al. Intelligent Multi-Modal Sensing-Communication Integration: Synesthesia of Machines. IEEE Communications Surveys & Tutorials. 2024;26(1):258-301. doi:10.1109/comst.2023.3336917

BibTeX
@article{Cheng2024,
  author = {Cheng, Xiang and Zhang, Haotian and Zhang, Jianan and Gao, Shijian and Li, Sijiang and Huang, Ziwei and Bai, Lu and Yang, Zonghui and Zheng, Xinhu and Yang, Liuqing},
  title = {Intelligent Multi-Modal Sensing-Communication Integration: Synesthesia of Machines},
  journal = {IEEE Communications Surveys & Tutorials},
  year = {2024},
  volume = {26},
  number = {1},
  pages = {258--301},
  doi = {10.1109/comst.2023.3336917}
}
Kostenlos starten →