Real-Time Acoustic Detection of Critical Incidents in Smart Cities Using Artificial Intelligence and Edge Networks
Sensors · 20.04.2025 · 25 (8) · 2597
DOI: 10.3390/s25082597 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 20.04.2025. Verfasst von Ioannis Saradopoulos und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electronics, Hellenic Mediterranean University, 73133 Chania, Crete, Greece. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
We present a system that integrates diverse technologies to achieve real-time, distributed audio surveillance. The system employs a network of microphones mounted on ESP32 platforms, which transmit compressed audio chunks via an MQTT protocol to Raspberry Pi5 devices for acoustic classification. These devices host an audio transformer model trained on the AudioSet dataset, enabling the real-time classification and timestamping of audio events with high accuracy. The output of the transformer is kept in a database of events and is subsequently converted into JSON format. The latter is further parsed into a graph structure that encapsulates the annotated soundscape, providing a rich and dynamic representation of audio environments. These graphs are subsequently traversed and analyzed using dedicated Python code and large language models (LLMs), enabling the system to answer complex queries about the nature, relationships, and context of detected audio events. We introduce a novel graph parsing method that achieves low false-alarm rates. In the task of analyzing the audio from a 1 h and 40 min long movie featuring hazardous driving practices, our approach achieved an accuracy of 0.882, precision of 0.8, recall of 1.0, and an F1 score of 0.89. By combining the robustness of distributed sensing and the precision of transformer-based audio classification, our approach that treats audio as text paves the way for advanced applications in acoustic surveillance, environmental monitoring, and beyond.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Electronics, Hellenic Mediterranean University, 73133 Chania, Crete, Greece.
- Department of Music Technology & Acoustics, Hellenic Mediterranean University, 74133 Rethymno, Crete, Greece.
- Department of Computer Science, University of Milan, 20133 Milan, Italy.
- Institute of Computer Science, Foundation for Research and Technology-Hellas, 70013 Heraklion, Crete, Greece.
ORCID-Profile: Ioannis Saradopoulos, Ilyas Potamitis, Stavros Ntalampiras, Antonios Konstantaras
Zitieren
APA
Saradopoulos, I., Potamitis, I., Ntalampiras, S., Rigakis, I., Manifavas, C., & Konstantaras, A. (2025). Real-Time Acoustic Detection of Critical Incidents in Smart Cities Using Artificial Intelligence and Edge Networks. Sensors, 25(8), 2597. https://doi.org/10.3390/s25082597
Vancouver
Saradopoulos I, Potamitis I, Ntalampiras S, Rigakis I, Manifavas C, Konstantaras A. Real-Time Acoustic Detection of Critical Incidents in Smart Cities Using Artificial Intelligence and Edge Networks. Sensors. 2025;25(8):2597. doi:10.3390/s25082597
BibTeX
@article{Saradopoulos2025,
author = {Saradopoulos, Ioannis and Potamitis, Ilyas and Ntalampiras, Stavros and Rigakis, Iraklis and Manifavas, Charalampos and Konstantaras, Antonios},
title = {Real-Time Acoustic Detection of Critical Incidents in Smart Cities Using Artificial Intelligence and Edge Networks},
journal = {Sensors},
year = {2025},
volume = {25},
number = {8},
pages = {2597},
doi = {10.3390/s25082597}
}
EUVIMED