Collaborative Joint Perception and Prediction for Autonomous Driving
Sensors · 27.09.2024 · 24 (19) · 6263
DOI: 10.3390/s24196263 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 27.09.2024. Verfasst von Shunli Ren und 2 weiteren Autor:innen. Beteiligte Einrichtung: Cooperative Medianet Innovation Center, Shanghai Jiao Tong University, Shanghai 200240, China. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, National Key R&D Program of China, the Science and Technology Commission of Shanghai Municipal.
Abstract (Originalsprache)
Collaboration among road agents, such as connected autonomous vehicles and roadside units, enhances driving performance by enabling the exchange of valuable information. However, existing collaboration methods predominantly focus on perception tasks and rely on single-frame static information sharing, which limits the effective exchange of temporal data and hinders broader applications of collaboration. To address this challenge, we propose CoPnP, a novel collaborative joint perception and prediction system, whose core innovation is to realize multi-frame spatial–temporal information sharing. To achieve effective and communication-efficient information sharing, two novel designs are proposed: (1) a task-oriented spatial–temporal information-refinement model, which filters redundant and noisy multi-frame features into concise representations; (2) a spatial–temporal importance-aware feature-fusion model, which comprehensively fuses features from various agents. The proposed CoPnP expands the benefits of collaboration among road agents to the joint perception and prediction task. The experimental results demonstrate that CoPnP outperforms existing state-of-the-art collaboration methods, achieving a significant performance-communication trade-off and yielding up to 11.51%/10.34% Intersection over union and 12.31%/10.96% video panoptic quality gains over single-agent PnP on the OPV2V/V2XSet datasets.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Cooperative Medianet Innovation Center, Shanghai Jiao Tong University, Shanghai 200240, China.
ORCID-Profile: Shunli Ren, Siheng Chen, Wenjun Zhang
Förderung
- National Natural Science Foundation of China
- National Key R&D Program of China
- the Science and Technology Commission of Shanghai Municipal
- National Key R&D Program of China
- NSFC
- Science and Technology Commission of Shanghai Municipal
Zitieren
APA
Ren, S., Chen, S., & Zhang, W. (2024). Collaborative Joint Perception and Prediction for Autonomous Driving. Sensors, 24(19), 6263. https://doi.org/10.3390/s24196263
Vancouver
Ren S, Chen S, Zhang W. Collaborative Joint Perception and Prediction for Autonomous Driving. Sensors. 2024;24(19):6263. doi:10.3390/s24196263
BibTeX
@article{Ren2024,
author = {Ren, Shunli and Chen, Siheng and Zhang, Wenjun},
title = {Collaborative Joint Perception and Prediction for Autonomous Driving},
journal = {Sensors},
year = {2024},
volume = {24},
number = {19},
pages = {6263},
doi = {10.3390/s24196263}
}
EUVIMED