EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

RMP: Robust Multi-Modal Perception Under Missing Condition

Xin Ma, Xuqi Cai, Yuansheng Song, Yu Liang, Gang Liu, Yijun Yang

Electronics · 26.12.2025 · 15 (1) · 119

DOI: 10.3390/electronics15010119 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 26.12.2025. Verfasst von Xin Ma und 5 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: China Postdoctoral Science Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multi-modal perception is a core technology for edge devices to achieve safe and reliable environmental understanding in autonomous driving scenarios. In recent years, most approaches have focused on integrating complementary signals from diverse sensors, including cameras and LiDAR, to improve scene understanding in complex traffic environments, thereby attracting significant attention. However, in real-world applications, sensor failures frequently occur; for instance, cameras may malfunction in scenarios with poor illumination, which severely reduces the accuracy of perception models. To overcome this issue, we propose a robust multi-modal perception pipeline designed to improve model performance under missing modality conditions. Specifically, we design a missing feature reconstruction mechanism to reconstruct absent features by leveraging intra-modal common clues. Furthermore, we introduce a multi-modal adaptive fusion strategy to facilitate adaptive multi-modal integration through inter-modal feature interactions. Extensive experiments on the nuScenes benchmark demonstrate that our method achieves SOTA-level performance under missing-modality conditions.

Förderung

  • China Postdoctoral Science Foundation

Zitieren

APA

Ma, X., Cai, X., Song, Y., Liang, Y., Liu, G., & Yang, Y. (2025). RMP: Robust Multi-Modal Perception Under Missing Condition. Electronics, 15(1), 119. https://doi.org/10.3390/electronics15010119

Vancouver

Ma X, Cai X, Song Y, Liang Y, Liu G, Yang Y. RMP: Robust Multi-Modal Perception Under Missing Condition. Electronics. 2025;15(1):119. doi:10.3390/electronics15010119

BibTeX
@article{Ma2025,
  author = {Ma, Xin and Cai, Xuqi and Song, Yuansheng and Liang, Yu and Liu, Gang and Yang, Yijun},
  title = {RMP: Robust Multi-Modal Perception Under Missing Condition},
  journal = {Electronics},
  year = {2025},
  volume = {15},
  number = {1},
  pages = {119},
  doi = {10.3390/electronics15010119}
}
Kostenlos starten →