Toward Low-Latency Cross-Modal Communication: A Flexible Prediction Scheme
IEEE Transactions on Mobile Computing · 2024-12 · 23 (12) · 13310-13324
DOI: 10.1109/tmc.2024.3425733 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Mobile Computing, 2024-12. Verfasst von Yanan Chen und 5 weiteren Autor:innen. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 43 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Priority Academic Program Development of Jiangsu Higher Education Institutions, Postgraduate Research & Practice Innovation Program of Jiangsu Province.
Abstract (Originalsprache)
To ensure the users’ immersive experience in cross-modal communication, overcoming the end-to-end (E2E) latency through prediction has attracted attention and shown its superiority. However, existing prediction schemes encounter formidable challenges in the presence of multi-modal signals, primarily to adapt and satisfy the prediction requirements of diverse multi-modal services, as well as to fully exploit and effectively utilize the correlation features of multi-modal signals for precise prediction. To this end, this work presents a flexible prediction scheme for low-latency cross-modal communication. Specifically, we first propose an adaptive prediction-aware cross-modal communication framework, which reduces the delay by predicting and transmitting the future multi-modal signals in advance, and flexibly adjusts the prediction horizon to satisfy the prediction accuracy of different multi-modal services. Next, we design an information gain-assisted graph attention (IGGA) method for cross-modal signal prediction, which leverages the graph attention block to extract the intra-modal, inter-modal spatial and temporal correlation features, and effectively optimize and utilize these features with the information gain (IG), thereby facilitating precise cross-modal signal prediction. Finally, numerical experiments conducted on a self-built dataset, a public dataset, and a multi-modal acupuncture platform demonstrate the superiority of the proposed scheme in low-latency cross-modal communication.
Förderung
- National Natural Science Foundation of China
- Priority Academic Program Development of Jiangsu Higher Education Institutions
- Postgraduate Research & Practice Innovation Program of Jiangsu Province
Zitieren
APA
Chen, Y., Li, P., Li, A., Wu, D., Zhou, L., & Qian, Y. (2024). Toward Low-Latency Cross-Modal Communication: A Flexible Prediction Scheme. IEEE Transactions on Mobile Computing, 23(12), 13310-13324. https://doi.org/10.1109/tmc.2024.3425733
Vancouver
Chen Y, Li P, Li A, Wu D, Zhou L, Qian Y. Toward Low-Latency Cross-Modal Communication: A Flexible Prediction Scheme. IEEE Transactions on Mobile Computing. 2024;23(12):13310-13324. doi:10.1109/tmc.2024.3425733
BibTeX
@article{Chen2024,
author = {Chen, Yanan and Li, Peilin and Li, Ang and Wu, Dan and Zhou, Liang and Qian, Yi},
title = {Toward Low-Latency Cross-Modal Communication: A Flexible Prediction Scheme},
journal = {IEEE Transactions on Mobile Computing},
year = {2024},
volume = {23},
number = {12},
pages = {13310--13324},
doi = {10.1109/tmc.2024.3425733}
}
EUVIMED