Audio-based event detection in the operating room
International Journal of Computer Assisted Radiology and Surgery · 2024
DOI: 10.1007/s11548-024-03211-1 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Computer Assisted Radiology and Surgery, 2024. Verfasst von Jonas Fuchtmann und 8 weiteren Autor:innen. Beteiligte Einrichtung: Research Group MITI, Klinikum rechts der Isar, TUM School of Medicine and Health, Technical University of Munich, Munich, Germany. jonas.fuchtmann@tu…. Hauptthemen laut MEDLINE: Operating Rooms. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Technische Universität München.
Abstract (Originalsprache)
Purpose
Even though workflow analysis in the operating room has come a long way, current systems are still limited to research. In the quest for a robust, universal setup, hardly any attention has been given to the dimension of audio despite its numerous advantages, such as low costs, location, and sight independence, or little required processing power. Methodology We present an approach for audio-based event detection that solely relies on two microphones capturing the sound in the operating room. Therefore, a new data set was created with over 63 h of audio recorded and annotated at the University Hospital rechts der Isar. Sound files were labeled, preprocessed, augmented, and subsequently converted to log-mel-spectrograms that served as a visual input for an event classification using pretrained convolutional neural networks.
Results
Comparing multiple architectures, we were able to show that even lightweight models, such as MobileNet, can already provide promising results. Data augmentation additionally improved the classification of 11 defined classes, including inter alia different types of coagulation, operating table movements as well as an idle class. With the newly created audio data set, an overall accuracy of 90%, a precision of 91% and a F 1-score of 91% were achieved, demonstrating the feasibility of an audio-based event recognition in the operating room.
Conclusion
With this first proof of concept, we demonstrated that audio events can serve as a meaningful source of information that goes beyond spoken language and can easily be integrated into future workflow recognition pipelines using computational inexpensive architectures.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Research Group MITI, Klinikum rechts der Isar, TUM School of Medicine and Health, Technical University of Munich, Munich, Germany. jonas.fuchtmann@tum.de.
- Department of Surgery, Klinikum rechts der Isar, TUM School of Medicine and Health, Technical University of Munich, Munich, Germany. jonas.fuchtmann@tum.de.
- Research Group MITI, Klinikum rechts der Isar, TUM School of Medicine and Health, Technical University of Munich, Munich, Germany.
- Department of Surgery, Klinikum rechts der Isar, TUM School of Medicine and Health, Technical University of Munich, Munich, Germany.
- University Hospital of Hearing, Speech and Voice Disorders, Medical University of Innsbruck, Innsbruck, Austria.
Förderung
- Technische Universität München
Zitieren
APA
Fuchtmann, J., Riedel, T., Berlet, M., Jell, A., Wegener, L., Wagner, L., Graf, S., Wilhelm, D., & Ostler-Mildner, D. (2024). Audio-based event detection in the operating room. International Journal of Computer Assisted Radiology and Surgery. https://doi.org/10.1007/s11548-024-03211-1
Vancouver
Fuchtmann J, Riedel T, Berlet M, Jell A, Wegener L, Wagner L, et al. Audio-based event detection in the operating room. International Journal of Computer Assisted Radiology and Surgery. 2024. doi:10.1007/s11548-024-03211-1
BibTeX
@article{Fuchtmann2024,
author = {Fuchtmann, Jonas and Riedel, Thomas and Berlet, Maximilian and Jell, Alissa and Wegener, Luca and Wagner, Lars and Graf, Simone and Wilhelm, Dirk and Ostler-Mildner, Daniel},
title = {Audio-based event detection in the operating room},
journal = {International Journal of Computer Assisted Radiology and Surgery},
year = {2024},
doi = {10.1007/s11548-024-03211-1}
}
EUVIMED