EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

DroneAVFusion: Towards Drone-Incursion Detection and Classification Using Acoustic–Visual Fusion

Sanad Asim Barsiq, Shafíi Nour Iśhak, Zeyad Aljundi, Taqwa Alhaj, Jonghyuk Kim, Shifeng Wang

Drones · 27.10.2026 · 10 (11) · 806

DOI: 10.3390/drones10110806 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Drones, online erschienen am 27.10.2026. Verfasst von Sanad Asim Barsiq und 5 weiteren Autor:innen. Die Arbeit nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Naif Arab University for Security Sciences.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The rapid development of small unmanned aerial vehicles (UAVs) has introduced significant challenges in both civilian and defense security domains, such as public safety and protecting critical infrastructure. Detecting and classifying misused drones intruding into low-altitude, cluttered environments remains particularly challenging because of limitations in robust fusion across multiple sensing modalities. Although acoustic and visual fusion has been widely studied, its use for detecting intruding drones has not been sufficiently investigated. This paper proposes DroneAVFusion, a lightweight acoustic–visual fusion pipeline that integrates acoustic and visual sensing via a novel Late Attention Fusion (LAF) mechanism. The proposed system combines a Mel-spectrogram-based convolutional neural network for acoustic detection and optimized YOLO-based visual detection, followed by a computationally efficient fusion module that dynamically weights modalities using confidence-aware gating and temperature-scaled attention. A custom acoustic–visual dataset comprising three commercial drones and non-drone objects is collected and used to evaluate performance under realistic conditions. Experimental results show that DroneAVFusion achieves a 99.6% F1 score on the validation set and perfect performance on the test set while running at an average of 30.40 FPS with only 72,868 parameters in the fusion module. Compared with single-modality baselines and existing fusion approaches, the proposed method demonstrates excellent robustness, making it well-suited for security applications.

Förderung

  • Naif Arab University for Security Sciences

Zitieren

APA

Barsiq, S. A., Iśhak, S. N., Aljundi, Z., Alhaj, T., Kim, J., & Wang, S. (2026). DroneAVFusion: Towards Drone-Incursion Detection and Classification Using Acoustic–Visual Fusion. Drones, 10(11), 806. https://doi.org/10.3390/drones10110806

Vancouver

Barsiq SA, Iśhak SN, Aljundi Z, Alhaj T, Kim J, Wang S. DroneAVFusion: Towards Drone-Incursion Detection and Classification Using Acoustic–Visual Fusion. Drones. 2026;10(11):806. doi:10.3390/drones10110806

BibTeX
@article{Barsiq2026,
  author = {Barsiq, Sanad Asim and Iśhak, Shafíi Nour and Aljundi, Zeyad and Alhaj, Taqwa and Kim, Jonghyuk and Wang, Shifeng},
  title = {DroneAVFusion: Towards Drone-Incursion Detection and Classification Using Acoustic–Visual Fusion},
  journal = {Drones},
  year = {2026},
  volume = {10},
  number = {11},
  pages = {806},
  doi = {10.3390/drones10110806}
}
Kostenlos starten →