EUVIMEDEUVIMED entdecken
Crossref

RaLiFlow: Scene Flow Estimation with 4D Radar and LiDAR Point Clouds

Jingyun Fu, Zhiyu Xiang, Na Zhao

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (5) · 4012-4021

DOI: 10.1609/aaai.v40i5.37404 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Jingyun Fu und 2 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recent multimodal fusion methods, integrating images with LiDAR point clouds, have shown promise in scene flow estimation. However, the fusion of 4D millimeter wave radar and LiDAR remains unexplored. Unlike LiDAR, radar is cheaper, more robust in various weather conditions and can detect point-wise velocity, making it a valuable complement to LiDAR. However, radar inputs pose challenges due to noise, low resolution, and sparsity. Moreover, there is currently no dataset that combines LiDAR and radar data specifically for scene flow estimation. To address this gap, we construct a Radar-LiDAR scene flow dataset based on a public real-world automotive dataset. We propose an effective preprocessing strategy for radar denoising and scene flow label generation, deriving more reliable flow ground truth for radar points out of the object boundaries. Additionally, we introduce RaLiFlow, the first joint scene flow learning framework for 4D radar and LiDAR, which achieves effective radar-LiDAR fusion through a novel Dynamic-aware Bidirectional Cross-modal Fusion (DBCF) module and a carefully designed set of loss functions. The DBCF module integrates dynamic cues from radar into the local cross-attention mechanism, enabling the propagation of contextual information across modalities. Meanwhile, the proposed loss functions mitigate the adverse effects of unreliable radar data during training and enhance the instance-level consistency in scene flow predictions from both modalities, particularly for dynamic foreground areas. Extensive experiments on the repurposed scene flow dataset demonstrate that our method outperforms existing LiDAR-based and radar-based single-modal methods by a significant margin.

Zitieren

APA

Fu, J., Xiang, Z., & Zhao, N. (2026). RaLiFlow: Scene Flow Estimation with 4D Radar and LiDAR Point Clouds. Proceedings of the AAAI Conference on Artificial Intelligence, 40(5), 4012-4021. https://doi.org/10.1609/aaai.v40i5.37404

Vancouver

Fu J, Xiang Z, Zhao N. RaLiFlow: Scene Flow Estimation with 4D Radar and LiDAR Point Clouds. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(5):4012-4021. doi:10.1609/aaai.v40i5.37404

BibTeX
@article{Fu2026,
  author = {Fu, Jingyun and Xiang, Zhiyu and Zhao, Na},
  title = {RaLiFlow: Scene Flow Estimation with 4D Radar and LiDAR Point Clouds},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {5},
  pages = {4012--4021},
  doi = {10.1609/aaai.v40i5.37404}
}
Kostenlos starten →