MA-DDSCNet: multi-agent dynamic diffusion semantic communication network for task-oriented multi-modal fusion in autonomous driving
PeerJ Computer Science · 27.04.2026 · 12 · e3669
DOI: 10.7717/peerj-cs.3669 ↗Kurz gefasst
Fachartikel in der Zeitschrift PeerJ Computer Science, online erschienen am 27.04.2026. Verfasst von Jiajun Zou und 4 weiteren Autor:innen. Die Arbeit nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: Characteristic Innovation Category Project of Guangdong Ordinary Colleges and Universities, Guangdong Province Key Construction Discipline Research Capacity Enhancement Project, Young Innovative Talents Category Project of Guangdong Ordinary Colleges and Universities.
Abstract (Originalsprache)
In bandwidth-limited and time-varying vehicle–road–cloud cooperative autonomous driving scenarios, real-time transmission and joint inference of high-dimensional multimodal perception data are simultaneously constrained by latency, reliability, and energy consumption. To address these challenges, this article proposes a task-oriented multimodal fusion framework named Multi-Agent Dynamic Diffusion Semantic Communication Network (MA-DDSCNet). On the vehicle side, we design a Task-Guided Multi-Modal Semantic Encoder (TG-MMSE) that performs spatio-temporal alignment, complementary memory gating, and differentiable discrete quantization to compress heterogeneous perception streams from cameras, Light Detection and Ranging (LiDAR), and vehicular state into task-weighted discrete token sequences. A hierarchical distillation scheme is further employed to maintain a unified semantic coordinate system across vehicles, Road Side Units (RSUs), and the cloud. On the communication side, a hierarchical controllable diffusion mechanism adaptively adjusts diffusion noise and time steps according to the importance of object detection, trajectory prediction, and motion planning tasks, as well as link-specific bandwidth budgets. A multi-agent deep scheduler enables collaborative utilization of communication resources among the cloud, RSUs, and vehicles, while an iterative joint semantic decoding and consistency calibration algorithm feeds residuals back into a global memory matrix to suppress semantic drift and yield isomorphic semantic representations at all three layers. Furthermore, we construct a learnable uncertainty-driven multi-objective loss function, combined with a gradient projection strategy, to achieve end-to-end joint optimization of detection, prediction, and planning within a single training loop. Simulation results demonstrate that, compared with baseline methods, MA-DDSCNet achieves average gains of 9.6–18.4% in mean Average Precision (mAP), Average Displacement Error (ADE), Final Displacement Error (FDE), Effective Bit Rate (EBR), and planning safety rate, while reducing the 95th-percentile end-to-end latency to 63 ms, indicating that the proposed framework can significantly enhance the overall performance of semantic perception tasks in complex vehicular networks.
Förderung
- Characteristic Innovation Category Project of Guangdong Ordinary Colleges and Universities
- Guangdong Province Key Construction Discipline Research Capacity Enhancement Project
- Young Innovative Talents Category Project of Guangdong Ordinary Colleges and Universities
- 2024 Natural Science Platforms and Projects for General Colleges and Universities in Guangdong Province
- School-level Scientific Research Project of Guangzhou Xinhua University
Zitieren
APA
Zou, J., Liu, S., Ye, S., Wang, F., & Dong, M. (2026). MA-DDSCNet: multi-agent dynamic diffusion semantic communication network for task-oriented multi-modal fusion in autonomous driving. PeerJ Computer Science, 12, e3669. https://doi.org/10.7717/peerj-cs.3669
Vancouver
Zou J, Liu S, Ye S, Wang F, Dong M. MA-DDSCNet: multi-agent dynamic diffusion semantic communication network for task-oriented multi-modal fusion in autonomous driving. PeerJ Computer Science. 2026;12:e3669. doi:10.7717/peerj-cs.3669
BibTeX
@article{Zou2026,
author = {Zou, Jiajun and Liu, Shaojiang and Ye, Shitong and Wang, Feng and Dong, Meixia},
title = {MA-DDSCNet: multi-agent dynamic diffusion semantic communication network for task-oriented multi-modal fusion in autonomous driving},
journal = {PeerJ Computer Science},
year = {2026},
volume = {12},
pages = {e3669},
doi = {10.7717/peerj-cs.3669}
}
EUVIMED