EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Deep Camera–Radar Fusion with an Attention Framework for Autonomous Vehicle Vision in Foggy Weather Conditions

Isaac Ogunrinde iD, Shonda Bernadin

Sensors · 09.07.2023 · 23 (14) · 6255

DOI: 10.3390/s23146255 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 09.07.2023. Verfasst von Isaac Ogunrinde und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electrical and Computer Engineering, FAMU-FSU College of Engineering, Tallahassee, FL 32310, USA. Die Arbeit wurde bisher 27-mal zitiert (Crossref) und nennt 82 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

AVs are affected by reduced maneuverability and performance due to the degradation of sensor performances in fog. Such degradation can cause significant object detection errors in AVs’ safety-critical conditions. For instance, YOLOv5 performs well under favorable weather but is affected by mis-detections and false positives due to atmospheric scattering caused by fog particles. The existing deep object detection techniques often exhibit a high degree of accuracy. Their drawback is being sluggish in object detection in fog. Object detection methods with a fast detection speed have been obtained using deep learning at the expense of accuracy. The problem of the lack of balance between detection speed and accuracy in fog persists. This paper presents an improved YOLOv5-based multi-sensor fusion network that combines radar object detection with a camera image bounding box. We transformed radar detection by mapping the radar detections into a two-dimensional image coordinate and projected the resultant radar image onto the camera image. Using the attention mechanism, we emphasized and improved the important feature representation used for object detection while reducing high-level feature information loss. We trained and tested our multi-sensor fusion network on clear and multi-fog weather datasets obtained from the CARLA simulator. Our results show that the proposed method significantly enhances the detection of small and distant objects. Our small CR-YOLOnet model best strikes a balance between accuracy and speed, with an accuracy of 0.849 at 69 fps.

Schlagwörter

Stichwörter der Autor:innen

adverse weatherattention moduleautonomous vehiclescamera–radardeep learningfogobject detectionsensor fusion

Autor:innen und Institutionen

  • Department of Electrical and Computer Engineering, FAMU-FSU College of Engineering, Tallahassee, FL 32310, USA.

ORCID-Profile: Isaac Ogunrinde

Zitieren

APA

Ogunrinde, I., & Bernadin, S. (2023). Deep Camera–Radar Fusion with an Attention Framework for Autonomous Vehicle Vision in Foggy Weather Conditions. Sensors, 23(14), 6255. https://doi.org/10.3390/s23146255

Vancouver

Ogunrinde I, Bernadin S. Deep Camera–Radar Fusion with an Attention Framework for Autonomous Vehicle Vision in Foggy Weather Conditions. Sensors. 2023;23(14):6255. doi:10.3390/s23146255

BibTeX
@article{Ogunrinde2023,
  author = {Ogunrinde, Isaac and Bernadin, Shonda},
  title = {Deep Camera–Radar Fusion with an Attention Framework for Autonomous Vehicle Vision in Foggy Weather Conditions},
  journal = {Sensors},
  year = {2023},
  volume = {23},
  number = {14},
  pages = {6255},
  doi = {10.3390/s23146255}
}
Kostenlos starten →