EUVIMEDEUVIMED entdecken
Crossref

Toward Low-Latency Cross-Modal Communication: A Flexible Prediction Scheme

Yanan Chen, Peilin Li, Ang Li, Dan Wu, Liang Zhou, Yi Qian

IEEE Transactions on Mobile Computing · 2024-12 · 23 (12) · 13310-13324

DOI: 10.1109/tmc.2024.3425733 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Mobile Computing, 2024-12. Verfasst von Yanan Chen und 5 weiteren Autor:innen. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 43 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Priority Academic Program Development of Jiangsu Higher Education Institutions, Postgraduate Research & Practice Innovation Program of Jiangsu Province.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

To ensure the users’ immersive experience in cross-modal communication, overcoming the end-to-end (E2E) latency through prediction has attracted attention and shown its superiority. However, existing prediction schemes encounter formidable challenges in the presence of multi-modal signals, primarily to adapt and satisfy the prediction requirements of diverse multi-modal services, as well as to fully exploit and effectively utilize the correlation features of multi-modal signals for precise prediction. To this end, this work presents a flexible prediction scheme for low-latency cross-modal communication. Specifically, we first propose an adaptive prediction-aware cross-modal communication framework, which reduces the delay by predicting and transmitting the future multi-modal signals in advance, and flexibly adjusts the prediction horizon to satisfy the prediction accuracy of different multi-modal services. Next, we design an information gain-assisted graph attention (IGGA) method for cross-modal signal prediction, which leverages the graph attention block to extract the intra-modal, inter-modal spatial and temporal correlation features, and effectively optimize and utilize these features with the information gain (IG), thereby facilitating precise cross-modal signal prediction. Finally, numerical experiments conducted on a self-built dataset, a public dataset, and a multi-modal acupuncture platform demonstrate the superiority of the proposed scheme in low-latency cross-modal communication.

Förderung

  • National Natural Science Foundation of China
  • Priority Academic Program Development of Jiangsu Higher Education Institutions
  • Postgraduate Research & Practice Innovation Program of Jiangsu Province

Zitieren

APA

Chen, Y., Li, P., Li, A., Wu, D., Zhou, L., & Qian, Y. (2024). Toward Low-Latency Cross-Modal Communication: A Flexible Prediction Scheme. IEEE Transactions on Mobile Computing, 23(12), 13310-13324. https://doi.org/10.1109/tmc.2024.3425733

Vancouver

Chen Y, Li P, Li A, Wu D, Zhou L, Qian Y. Toward Low-Latency Cross-Modal Communication: A Flexible Prediction Scheme. IEEE Transactions on Mobile Computing. 2024;23(12):13310-13324. doi:10.1109/tmc.2024.3425733

BibTeX
@article{Chen2024,
  author = {Chen, Yanan and Li, Peilin and Li, Ang and Wu, Dan and Zhou, Liang and Qian, Yi},
  title = {Toward Low-Latency Cross-Modal Communication: A Flexible Prediction Scheme},
  journal = {IEEE Transactions on Mobile Computing},
  year = {2024},
  volume = {23},
  number = {12},
  pages = {13310--13324},
  doi = {10.1109/tmc.2024.3425733}
}
Kostenlos starten →