EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Integrated Multimodal Perception and Predictive Motion Forecasting via Cross-Modal Adaptive Attention

Bakhita Salman, Alexander Chavez, Muneeb Yassin

Future Transportation · 11.03.2026 · 6 (2) · 64

DOI: 10.3390/futuretransp6020064 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Future Transportation, online erschienen am 11.03.2026. Verfasst von Bakhita Salman und 2 weiteren Autor:innen. Die Arbeit nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: College of Arts and Sciences (COAS), Texas A&M International University.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Accurate environmental perception is fundamental to safe autonomous driving; however, most existing multimodal systems rely on fixed or heuristic sensor fusion strategies that cannot adapt to scene-dependent variations in sensor reliability. This paper proposes Cross-Modal Adaptive Attention (CMAA), a unified end-to-end Bird’s-Eye-View (BEV) perception framework that dynamically fuses camera, LiDAR, and RADAR information through learnable, context-aware modality gating. Unlike static fusion approaches, CMAA adaptively reweights sensor contributions based on global scene descriptors, enabling the robust integration of semantic, geometric, and motion cues without manual tuning. The proposed architecture jointly performs 3D object detection, multi-object tracking, and motion forecasting within a shared BEV representation, preserving spatial alignment across tasks and supporting efficient real-time deployment. Experiments conducted on the official nuScenes validation split demonstrate that CMAA achieves 0.528 mAP and 0.691 NDS, outperforming fixed-weight fusion baselines while maintaining a compact model size and efficient inference. Additional tracking evaluation using the official nuScenes tracking devkit reports improved tracking performance, while motion forecasting experiments show reduced trajectory displacement errors (minADE and minFDE). Ablation studies further confirm the complementary contributions of adaptive modality gating and bidirectional cross-modal refinement, and a stratified dynamic analysis reveals consistent reductions in velocity estimation error across object classes, motion regimes, and environmental conditions. These results demonstrate that adaptive multimodal fusion improves robustness, motion reasoning, and perception reliability in complex traffic environments while remaining computationally efficient for deployment in safety-critical autonomous driving systems.

Förderung

  • College of Arts and Sciences (COAS), Texas A&M International University

Zitieren

APA

Salman, B., Chavez, A., & Yassin, M. (2026). Integrated Multimodal Perception and Predictive Motion Forecasting via Cross-Modal Adaptive Attention. Future Transportation, 6(2), 64. https://doi.org/10.3390/futuretransp6020064

Vancouver

Salman B, Chavez A, Yassin M. Integrated Multimodal Perception and Predictive Motion Forecasting via Cross-Modal Adaptive Attention. Future Transportation. 2026;6(2):64. doi:10.3390/futuretransp6020064

BibTeX
@article{Salman2026,
  author = {Salman, Bakhita and Chavez, Alexander and Yassin, Muneeb},
  title = {Integrated Multimodal Perception and Predictive Motion Forecasting via Cross-Modal Adaptive Attention},
  journal = {Future Transportation},
  year = {2026},
  volume = {6},
  number = {2},
  pages = {64},
  doi = {10.3390/futuretransp6020064}
}
Kostenlos starten →