Pragmatic Communication in Multi-Agent Collaborative Perception
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2026-08 · 48 (8) · 9279-9296
DOI: 10.1109/tpami.2026.3680062 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2026-08. Verfasst von Yue Hu und 6 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 66 Literaturangaben. Gefördert von: National Key R&D Program of China, National Natural Science Foundation of China, Science and Technology Commission of Shanghai Municipal.
Abstract (Originalsprache)
Collaborative perception allows each agent to enhance its perceptual abilities by exchanging messages with others. It inherently results in a trade-off between perception ability and communication costs. Previous works transmit complete full-frame high-dimensional feature maps among agents, resulting in substantial communication costs. To promote communication efficiency, we propose only transmitting the information needed for the collaborator's downstream task. This pragmatic communication strategy focuses on three key aspects: i) pragmatic message selection, which selects task-critical parts from the complete data, resulting in spatially and temporally sparse feature vectors; ii) pragmatic message representation, which achieves pragmatic approximation of high-dimensional feature vectors with a task-adaptive dictionary, enabling communicating with integer indices; iii) pragmatic collaborator selection, which identifies beneficial collaborators, pruning unnecessary communication links. Following this strategy, we first formulate a mathematical optimization framework for the perception-communication trade-off and then propose PragComm, a multi-agent collaborative perception system with two key components: i) single-agent detection and tracking and ii) pragmatic collaboration. The proposed PragComm promotes pragmatic communication and adapts to a wide range of communication conditions. We evaluate PragComm for both collaborative 3D object detection and tracking tasks in both real-world, V2V4Real, and simulation datasets, OPV2V and V2X-SIM2.0. PragComm consistently outperforms previous methods with more than 32.7 K× lower communication volume on OPV2V.
Förderung
- National Key R&D Program of China
- National Natural Science Foundation of China
- Science and Technology Commission of Shanghai Municipal
Zitieren
APA
Hu, Y., Pang, X., Qin, X., Eldar, Y. C., Chen, S., Zhang, P., & Zhang, W. (2026). Pragmatic Communication in Multi-Agent Collaborative Perception. IEEE Transactions on Pattern Analysis and Machine Intelligence, 48(8), 9279-9296. https://doi.org/10.1109/tpami.2026.3680062
Vancouver
Hu Y, Pang X, Qin X, Eldar YC, Chen S, Zhang P, et al. Pragmatic Communication in Multi-Agent Collaborative Perception. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2026;48(8):9279-9296. doi:10.1109/tpami.2026.3680062
BibTeX
@article{Hu2026,
author = {Hu, Yue and Pang, Xianghe and Qin, Xiaoqi and Eldar, Yonina C and Chen, Siheng and Zhang, Ping and Zhang, Wenjun},
title = {Pragmatic Communication in Multi-Agent Collaborative Perception},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2026},
volume = {48},
number = {8},
pages = {9279--9296},
doi = {10.1109/tpami.2026.3680062}
}
EUVIMED