EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

RMF‐ED: Real‐Time Multimodal Fusion for Enhanced Target Detection in Low‐Light Environments

Yuhong Wu, Jinkai Cui, Kuoye Niu, Yanlong Lu, Lijun Cheng, Shengze Cai, Chao Xu

IET Cyber-Systems and Robotics · 2025-01 · 7 (1)

DOI: 10.1049/csy2.70011 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IET Cyber-Systems and Robotics, online erschienen am 07.04.2025. Verfasst von Yuhong Wu und 6 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Accurate target detection in low‐light environments is crucial for unmanned aerial vehicles (UAVs) and autonomous driving applications. In this study, the authors introduce a real‐time multimodal fusion for enhanced detection (RMF‐ED), a novel framework designed to overcome the limitations of low‐light target detection. By leveraging the complementary capabilities of near‐infrared (NIR) cameras and light detection and ranging (LiDAR) sensors, RMF‐ED enhances detection performance. An advanced NIR generative adversarial network (NIR‐GAN) model was developed to address the lack of annotated NIR datasets, integrating structural similarity index measure (SSIM) loss and L1 loss functions. This approach enables the generation of high‐quality NIR images from RGB datasets, bridging a critical gap in training data. Furthermore, the multimodal fusion algorithm integrates RGB images, NIR images, and LiDAR point clouds, ensuring consistency and accuracy in proposal fusion. Experimental results on the KITTI dataset demonstrate that RMF‐ED achieves performance comparable to or exceeding state‐of‐the‐art fusion algorithms, with a computational time of only 21 ms. These features make RMF‐ED an efficient and versatile solution for real‐time applications in low‐light environments.

Zitieren

APA

Wu, Y., Cui, J., Niu, K., Lu, Y., Cheng, L., Cai, S., & Xu, C. (2025). RMF‐ED: Real‐Time Multimodal Fusion for Enhanced Target Detection in Low‐Light Environments. IET Cyber-Systems and Robotics, 7(1). https://doi.org/10.1049/csy2.70011

Vancouver

Wu Y, Cui J, Niu K, Lu Y, Cheng L, Cai S, et al. RMF‐ED: Real‐Time Multimodal Fusion for Enhanced Target Detection in Low‐Light Environments. IET Cyber-Systems and Robotics. 2025;7(1). doi:10.1049/csy2.70011

BibTeX
@article{Wu2025,
  author = {Wu, Yuhong and Cui, Jinkai and Niu, Kuoye and Lu, Yanlong and Cheng, Lijun and Cai, Shengze and Xu, Chao},
  title = {RMF‐ED: Real‐Time Multimodal Fusion for Enhanced Target Detection in Low‐Light Environments},
  journal = {IET Cyber-Systems and Robotics},
  year = {2025},
  volume = {7},
  number = {1},
  doi = {10.1049/csy2.70011}
}
Kostenlos starten →