Robust Multi-Agent Collaborative Perception via Spatio-Temporal Awareness
IEEE Transactions on Circuits and Systems for Video Technology · 2025-06 · 35 (6) · 5644-5658
DOI: 10.1109/tcsvt.2025.3528980 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2025-06. Verfasst von Kun Yang und 6 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 62 Literaturangaben. Gefördert von: Ministry of Education-China Mobile Research Fund Major Project, Shanghai Municipal Science and Technology Major Project.
Abstract (Originalsprache)
As an emerging application in autonomous driving, multi-agent collaborative perception has recently received significant attention. Despite promising advances from previous efforts, several unavoidable challenges that cause performance bottlenecks remain, including the single-frame detection dilemma, communication redundancy, and defective collaboration process. To this end, we propose SCOPE++, a versatile collaborative perception framework aggregating spatio-temporal information across on-road agents to tackle these issues. We introduce four components in SCOPE++ for robust collaboration by seeking a reasonable trade-off between perception performance and communication bandwidth. First, we devise a context-aware information aggregation to capture valuable semantic cues in the temporal context and enhance the current local representation of the ego agent. Second, an exclusivity-aware sparse communication is introduced to filter perceptually unnecessary information from collaborators and transmit complementary features relative to the ego agent. Third, we present an importance-aware cross-agent collaboration to incorporate semantic representations of spatially critical locations across agents flexibly. Finally, a contribution-aware adaptive fusion is designed to integrate multi-source representations based on dynamic contributions. Our framework is evaluated on multiple LiDAR-based collaborative detection datasets in real-world and simulated scenarios, and comprehensive experiments show that SCOPE++ outperforms state-of-the-art methods on all datasets.
Förderung
- Ministry of Education-China Mobile Research Fund Major Project
- Shanghai Municipal Science and Technology Major Project
Zitieren
APA
Yang, K., Xu, Z., Yang, D., Fu, Q., Tang, R., Song, L., & Zhang, L. (2025). Robust Multi-Agent Collaborative Perception via Spatio-Temporal Awareness. IEEE Transactions on Circuits and Systems for Video Technology, 35(6), 5644-5658. https://doi.org/10.1109/tcsvt.2025.3528980
Vancouver
Yang K, Xu Z, Yang D, Fu Q, Tang R, Song L, et al. Robust Multi-Agent Collaborative Perception via Spatio-Temporal Awareness. IEEE Transactions on Circuits and Systems for Video Technology. 2025;35(6):5644-5658. doi:10.1109/tcsvt.2025.3528980
BibTeX
@article{Yang2025,
author = {Yang, Kun and Xu, Zhi and Yang, Dingkang and Fu, Qiang and Tang, Rui and Song, Liang and Zhang, Lihua},
title = {Robust Multi-Agent Collaborative Perception via Spatio-Temporal Awareness},
journal = {IEEE Transactions on Circuits and Systems for Video Technology},
year = {2025},
volume = {35},
number = {6},
pages = {5644--5658},
doi = {10.1109/tcsvt.2025.3528980}
}
EUVIMED