EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

MFE-SSNet: Multi-Modal Fusion-Based End-to-End Steering Angle and Vehicle Speed Prediction Network

Yi Huang, Wenzhuo Liu, Yaoyu Li, Lei Yang, Hanqi Jiang, Zhiwei Li, Jun Li

Automotive Innovation · 2024-11 · 7 (4) · 545-558

DOI: 10.1007/s42154-024-00296-x ↗

Kurz gefasst

Fachartikel in der Zeitschrift Automotive Innovation, online erschienen am 24.10.2024. Verfasst von Yi Huang und 6 weiteren Autor:innen. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 24 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In the field of autonomous vehicles, accurately predicting steering angle and speed is a pivotal task. This task affects the accuracy of the final decision of the autonomous vehicle and is the basis for ensuring the safe and efficient operation of the autonomous vehicle. Previous studies have often relied on data from only one or two modalities to make predictions for steering angle and vehicle speed, which were often inadequate. In this paper, the authors propose a Multi-Modal Fusion-Based End-to-End Steering Angle and Vehicle Speed Prediction Network (MFE-SSNet). The network innovatively extends the one-stream and two-stream structure to a three-stream structure and cleverly extracts features of images, steering angles, and vehicle speeds using HRNet and LSTM layers. In addition, in order to fully fuse the feature information of different modal data, this paper also proposes a local attention-based feature fusion module. This module improves the fusion of different modal feature vectors by capturing the interdependencies in the local channels. Experimental results demonstrate that MFE-SSNet outperforms the current state-of-the-art model on the publicly available Udacity dataset.

Zitieren

APA

Huang, Y., Liu, W., Li, Y., Yang, L., Jiang, H., Li, Z., & Li, J. (2024). MFE-SSNet: Multi-Modal Fusion-Based End-to-End Steering Angle and Vehicle Speed Prediction Network. Automotive Innovation, 7(4), 545-558. https://doi.org/10.1007/s42154-024-00296-x

Vancouver

Huang Y, Liu W, Li Y, Yang L, Jiang H, Li Z, et al. MFE-SSNet: Multi-Modal Fusion-Based End-to-End Steering Angle and Vehicle Speed Prediction Network. Automotive Innovation. 2024;7(4):545-558. doi:10.1007/s42154-024-00296-x

BibTeX
@article{Huang2024,
  author = {Huang, Yi and Liu, Wenzhuo and Li, Yaoyu and Yang, Lei and Jiang, Hanqi and Li, Zhiwei and Li, Jun},
  title = {MFE-SSNet: Multi-Modal Fusion-Based End-to-End Steering Angle and Vehicle Speed Prediction Network},
  journal = {Automotive Innovation},
  year = {2024},
  volume = {7},
  number = {4},
  pages = {545--558},
  doi = {10.1007/s42154-024-00296-x}
}
Kostenlos starten →