R-ACP: Real-Time Adaptive Collaborative Perception Leveraging Robust Task-Oriented Communications
IEEE Journal on Selected Areas in Communications · 2025-12 · 43 (12) · 4215-4230
DOI: 10.1109/jsac.2025.3623179 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Journal on Selected Areas in Communications, 2025-12. Verfasst von Zhengru Fang und 6 weiteren Autor:innen. Die Arbeit wurde bisher 35-mal zitiert (Crossref) und nennt 51 Literaturangaben. Gefördert von: JC STEM Lab of Smart City funded by Hong Kong Jockey Club Charities Trust, Research Grants Council of Hong Kong Special Administrative Region, China, under Project CityU, National Natural Science Foundation of China.
Abstract (Originalsprache)
Collaborative perception enhances sensing in multi-robot and vehicular networks by fusing information from multiple agents, improving perception accuracy and sensing range. However, mobility and non-rigid sensor mounts introduce extrinsic calibration errors, necessitating online calibration, further complicated by limited overlap in sensing regions. Moreover, maintaining fresh information is crucial for timely and accurate sensing. To address calibration errors and ensure timely and accurate perception, we propose a robust task-oriented communication strategy to optimize online self-calibration and efficient feature sharing for Real-time Adaptive Collaborative Perception (R-ACP). Specifically, we first formulate an Age of Perceived Targets (AoPT) minimization problem to capture data timeliness of multi-view streaming. Then, in the calibration phase, we introduce a channel-aware self-calibration technique based on re-identification (Re-ID), which adaptively compresses key features according to channel capacities, effectively addressing calibration issues via spatial and temporal cross-camera correlations. In the streaming phase, we tackle the trade-off between bandwidth and inference accuracy by leveraging an Information Bottleneck (IB)-based encoding method to adjust video compression rates based on task relevance, thereby reducing communication overhead and latency. Finally, we design a priority-aware network to filter corrupted features to mitigate performance degradation from packet corruption. Extensive studies demonstrate that our framework outperforms five baselines, improving multiple object detection accuracy (MODA) by 25.49% and reducing communication costs by 51.36% under severely poor channel conditions. Code will be made publicly available: github.com/fangzr/R-ACP
Förderung
- JC STEM Lab of Smart City funded by Hong Kong Jockey Club Charities Trust
- Research Grants Council of Hong Kong Special Administrative Region, China, under Project CityU
- National Natural Science Foundation of China
- Beijing Natural Science Foundation
- Natural Science Foundation of Zhejiang Province
- Research Grants Council of Hong Kong
- HKU-SCF FinTech Academy Research and Development Funding, and in part by HKU IDS Research Seed Fund
Zitieren
APA
Fang, Z., Wang, J., Ma, Y., Tao, Y., Deng, Y., Chen, X., & Fang, Y. (2025). R-ACP: Real-Time Adaptive Collaborative Perception Leveraging Robust Task-Oriented Communications. IEEE Journal on Selected Areas in Communications, 43(12), 4215-4230. https://doi.org/10.1109/jsac.2025.3623179
Vancouver
Fang Z, Wang J, Ma Y, Tao Y, Deng Y, Chen X, et al. R-ACP: Real-Time Adaptive Collaborative Perception Leveraging Robust Task-Oriented Communications. IEEE Journal on Selected Areas in Communications. 2025;43(12):4215-4230. doi:10.1109/jsac.2025.3623179
BibTeX
@article{Fang2025,
author = {Fang, Zhengru and Wang, Jingjing and Ma, Yanan and Tao, Yihang and Deng, Yiqin and Chen, Xianhao and Fang, Yuguang},
title = {R-ACP: Real-Time Adaptive Collaborative Perception Leveraging Robust Task-Oriented Communications},
journal = {IEEE Journal on Selected Areas in Communications},
year = {2025},
volume = {43},
number = {12},
pages = {4215--4230},
doi = {10.1109/jsac.2025.3623179}
}
EUVIMED