Enhancing Emergency Vehicle Detection: A Deep Learning Approach with Multimodal Fusion
Mathematics · 13.05.2024 · 12 (10) · 1514
DOI: 10.3390/math12101514 ↗Kurz gefasst
Fachartikel in der Zeitschrift Mathematics, online erschienen am 13.05.2024. Verfasst von Muhammad Zohaib und 2 weiteren Autor:innen. Die Arbeit wurde bisher 49-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: EIAS Data Science and Blockchain Laboratory College of Computer and Information Sciences, Prince Sultan University, Prince Sultan University.
Abstract (Originalsprache)
Emergency vehicle detection plays a critical role in ensuring timely responses and reducing accidents in modern urban environments. However, traditional methods that rely solely on visual cues face challenges, particularly in adverse conditions. The objective of this research is to enhance emergency vehicle detection by leveraging the synergies between acoustic and visual information. By incorporating advanced deep learning techniques for both acoustic and visual data, our aim is to significantly improve the accuracy and response times. To achieve this goal, we developed an attention-based temporal spectrum network (ATSN) with an attention mechanism specifically designed for ambulance siren sound detection. In parallel, we enhanced visual detection tasks by implementing a Multi-Level Spatial Fusion YOLO (MLSF-YOLO) architecture. To combine the acoustic and visual information effectively, we employed a stacking ensemble learning technique, creating a robust framework for emergency vehicle detection. This approach capitalizes on the strengths of both modalities, allowing for a comprehensive analysis that surpasses existing methods. Through our research, we achieved remarkable results, including a misdetection rate of only 3.81% and an accuracy of 96.19% when applied to visual data containing emergency vehicles. These findings represent significant progress in real-world applications, demonstrating the effectiveness of our approach in improving emergency vehicle detection systems.
Förderung
- EIAS Data Science and Blockchain Laboratory College of Computer and Information Sciences, Prince Sultan University
- Prince Sultan University
Zitieren
APA
Zohaib, M., Asim, M., & ELAffendi, M. (2024). Enhancing Emergency Vehicle Detection: A Deep Learning Approach with Multimodal Fusion. Mathematics, 12(10), 1514. https://doi.org/10.3390/math12101514
Vancouver
Zohaib M, Asim M, ELAffendi M. Enhancing Emergency Vehicle Detection: A Deep Learning Approach with Multimodal Fusion. Mathematics. 2024;12(10):1514. doi:10.3390/math12101514
BibTeX
@article{Zohaib2024,
author = {Zohaib, Muhammad and Asim, Muhammad and ELAffendi, Mohammed},
title = {Enhancing Emergency Vehicle Detection: A Deep Learning Approach with Multimodal Fusion},
journal = {Mathematics},
year = {2024},
volume = {12},
number = {10},
pages = {1514},
doi = {10.3390/math12101514}
}
EUVIMED