EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Enhancing Emergency Vehicle Detection: A Deep Learning Approach with Multimodal Fusion

Muhammad Zohaib, Muhammad Asim, Mohammed ELAffendi

Mathematics · 13.05.2024 · 12 (10) · 1514

DOI: 10.3390/math12101514 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Mathematics, online erschienen am 13.05.2024. Verfasst von Muhammad Zohaib und 2 weiteren Autor:innen. Die Arbeit wurde bisher 49-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: EIAS Data Science and Blockchain Laboratory College of Computer and Information Sciences, Prince Sultan University, Prince Sultan University.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Emergency vehicle detection plays a critical role in ensuring timely responses and reducing accidents in modern urban environments. However, traditional methods that rely solely on visual cues face challenges, particularly in adverse conditions. The objective of this research is to enhance emergency vehicle detection by leveraging the synergies between acoustic and visual information. By incorporating advanced deep learning techniques for both acoustic and visual data, our aim is to significantly improve the accuracy and response times. To achieve this goal, we developed an attention-based temporal spectrum network (ATSN) with an attention mechanism specifically designed for ambulance siren sound detection. In parallel, we enhanced visual detection tasks by implementing a Multi-Level Spatial Fusion YOLO (MLSF-YOLO) architecture. To combine the acoustic and visual information effectively, we employed a stacking ensemble learning technique, creating a robust framework for emergency vehicle detection. This approach capitalizes on the strengths of both modalities, allowing for a comprehensive analysis that surpasses existing methods. Through our research, we achieved remarkable results, including a misdetection rate of only 3.81% and an accuracy of 96.19% when applied to visual data containing emergency vehicles. These findings represent significant progress in real-world applications, demonstrating the effectiveness of our approach in improving emergency vehicle detection systems.

Förderung

  • EIAS Data Science and Blockchain Laboratory College of Computer and Information Sciences, Prince Sultan University
  • Prince Sultan University

Zitieren

APA

Zohaib, M., Asim, M., & ELAffendi, M. (2024). Enhancing Emergency Vehicle Detection: A Deep Learning Approach with Multimodal Fusion. Mathematics, 12(10), 1514. https://doi.org/10.3390/math12101514

Vancouver

Zohaib M, Asim M, ELAffendi M. Enhancing Emergency Vehicle Detection: A Deep Learning Approach with Multimodal Fusion. Mathematics. 2024;12(10):1514. doi:10.3390/math12101514

BibTeX
@article{Zohaib2024,
  author = {Zohaib, Muhammad and Asim, Muhammad and ELAffendi, Mohammed},
  title = {Enhancing Emergency Vehicle Detection: A Deep Learning Approach with Multimodal Fusion},
  journal = {Mathematics},
  year = {2024},
  volume = {12},
  number = {10},
  pages = {1514},
  doi = {10.3390/math12101514}
}
Kostenlos starten →