EUVIMEDObjevte EUVIMED
Open access · CC BY 4.0

RMP: Robust Multi-Modal Perception Under Missing Condition

Xin Ma, Xuqi Cai, Yuansheng Song, Yu Liang, Gang Liu, Yijun Yang

Electronics · 2025-12-26 · 15 (1) · 119

DOI: 10.3390/electronics15010119 ↗

At a glance

Journal article in Electronics, published online on 2025-12-26. Written by Xin Ma and 5 co-authors. Cited 4 times so far (Crossref); 41 references. The full text is freely available (open access, CC BY 4.0). Funded by: China Postdoctoral Science Foundation.

AbstraktBibliografické údajeCiteRelated studies

Abstract (original language)

Multi-modal perception is a core technology for edge devices to achieve safe and reliable environmental understanding in autonomous driving scenarios. In recent years, most approaches have focused on integrating complementary signals from diverse sensors, including cameras and LiDAR, to improve scene understanding in complex traffic environments, thereby attracting significant attention. However, in real-world applications, sensor failures frequently occur; for instance, cameras may malfunction in scenarios with poor illumination, which severely reduces the accuracy of perception models. To overcome this issue, we propose a robust multi-modal perception pipeline designed to improve model performance under missing modality conditions. Specifically, we design a missing feature reconstruction mechanism to reconstruct absent features by leveraging intra-modal common clues. Furthermore, we introduce a multi-modal adaptive fusion strategy to facilitate adaptive multi-modal integration through inter-modal feature interactions. Extensive experiments on the nuScenes benchmark demonstrate that our method achieves SOTA-level performance under missing-modality conditions.

Funding

  • China Postdoctoral Science Foundation

Cite

APA

Ma, X., Cai, X., Song, Y., Liang, Y., Liu, G., & Yang, Y. (2025). RMP: Robust Multi-Modal Perception Under Missing Condition. Electronics, 15(1), 119. https://doi.org/10.3390/electronics15010119

Vancouver

Ma X, Cai X, Song Y, Liang Y, Liu G, Yang Y. RMP: Robust Multi-Modal Perception Under Missing Condition. Electronics. 2025;15(1):119. doi:10.3390/electronics15010119

BibTeX
@article{Ma2025,
  author = {Ma, Xin and Cai, Xuqi and Song, Yuansheng and Liang, Yu and Liu, Gang and Yang, Yijun},
  title = {RMP: Robust Multi-Modal Perception Under Missing Condition},
  journal = {Electronics},
  year = {2025},
  volume = {15},
  number = {1},
  pages = {119},
  doi = {10.3390/electronics15010119}
}
Start for free →