EUVIMEDObjevte EUVIMED
Open access · CC BY 4.0

Graph Enhanced Multi-Modal Network of 4-D Radar-Camera Fusion for Perception in Autonomous Systems

Yuanzhi Deng iD, Cheng Chi, Jianhao Shen, Yu Han, Shanyin He, Shaolong Chen

Sensors · 2026-07-22 · 26 (14) · 4635

DOI: 10.3390/s26144635 ↗

At a glance

Journal article in Sensors, published online on 2026-07-22. Written by Yuanzhi Deng and 5 co-authors. Institution: School of Sino-German Intelligent Manufacturing, Shenzhen City Polytechnic, Shenzhen 518116, China. Cited 1 times so far (Crossref); 48 references. The full text is freely available (open access, CC BY 4.0). Funded by: Characteristic Innovation Project of Colleges and Universities in Guangdong Province, Department of Education of Guangdong Province Young Innovative Talents Program Project, Guangdong Province Ordinary University Machine Vision and Inspection Technology Innovation Team.

AbstraktSubjectsBibliografické údajeCiteRelated studies

Abstract (original language)

Modern autonomous systems rely on heterogeneous sensing modalities—including vision sensors, millimeter-wave radar, and LiDAR—yet each individual sensor exhibits characteristic failure modes in challenging real-world conditions. While LiDAR-vision co-processing has received extensive attention, the synergistic potential of 4D radar paired with monocular optics remains comparatively unexplored. To fill this gap, we develop a graph-enhanced multi-modal architecture that jointly leverages sparse 4D radar returns and high-resolution camera imagery for scene-level 3D perception. The proposed system is organized around four tightly coupled processing stages: (i) an image-guided point densification scheme (SAA) that augments sparse radar clouds with camera-derived pseudo measurements; (ii) a pose-invariant cross-modal fusion layer that harmonizes enriched radar features with image descriptors and object saliency maps; (iii) a dynamic hypergraph assembly stage that captures higher-order inter-object and cross-sensor dependencies; and (iv) a HyperGCN inference module that regresses 3D bounding parameters and class labels on the resulting relational graph. Integrating the temporal velocity cues native to radar with the rich appearance information from cameras, the system delivers reliable perception under diverse environmental conditions. On the View-of-Delft (VOD) evaluation suite, the proposed model records an mAP of 69.3 and mAOS of 59.8. A systematic ablation further quantifies how geometric invariance—across translation, rotation, and scale transformations—individually affects end-to-end detection fidelity.

Subjects

Author keywords

4-D radarautonomous perceptionhypergraphobject detectionsensor fusion

Authors and institutions

  • School of Sino-German Intelligent Manufacturing, Shenzhen City Polytechnic, Shenzhen 518116, China.
  • Guangdong Engineering Center for Intelligent Sensing and Flexible Manufacturing, Shenzhen City Polytechnic, Shenzhen 518116, China.
  • College of Urban Transportation and Logistics, Shenzhen Technology University, Shenzhen 518118, China.

ORCID profiles: Yuanzhi Deng

Funding

  • Characteristic Innovation Project of Colleges and Universities in Guangdong Province
  • Department of Education of Guangdong Province Young Innovative Talents Program Project
  • Guangdong Province Ordinary University Machine Vision and Inspection Technology Innovation Team
  • Doctoral Research Startup Fund Project

Cite

APA

Deng, Y., Chi, C., Shen, J., Han, Y., He, S., & Chen, S. (2026). Graph Enhanced Multi-Modal Network of 4-D Radar-Camera Fusion for Perception in Autonomous Systems. Sensors, 26(14), 4635. https://doi.org/10.3390/s26144635

Vancouver

Deng Y, Chi C, Shen J, Han Y, He S, Chen S. Graph Enhanced Multi-Modal Network of 4-D Radar-Camera Fusion for Perception in Autonomous Systems. Sensors. 2026;26(14):4635. doi:10.3390/s26144635

BibTeX
@article{Deng2026,
  author = {Deng, Yuanzhi and Chi, Cheng and Shen, Jianhao and Han, Yu and He, Shanyin and Chen, Shaolong},
  title = {Graph Enhanced Multi-Modal Network of 4-D Radar-Camera Fusion for Perception in Autonomous Systems},
  journal = {Sensors},
  year = {2026},
  volume = {26},
  number = {14},
  pages = {4635},
  doi = {10.3390/s26144635}
}
Start for free →