EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Audio-based event detection in the operating room

Jonas Fuchtmann, Thomas Riedel, Maximilian Berlet, Alissa Jell, Luca Wegener, Lars Wagner, Simone Graf, Dirk Wilhelm, Daniel Ostler-Mildner

International Journal of Computer Assisted Radiology and Surgery · 2024

DOI: 10.1007/s11548-024-03211-1 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Computer Assisted Radiology and Surgery, 2024. Verfasst von Jonas Fuchtmann und 8 weiteren Autor:innen. Beteiligte Einrichtung: Research Group MITI, Klinikum rechts der Isar, TUM School of Medicine and Health, Technical University of Munich, Munich, Germany. jonas.fuchtmann@tu…. Hauptthemen laut MEDLINE: Operating Rooms. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Technische Universität München.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Purpose

Even though workflow analysis in the operating room has come a long way, current systems are still limited to research. In the quest for a robust, universal setup, hardly any attention has been given to the dimension of audio despite its numerous advantages, such as low costs, location, and sight independence, or little required processing power. Methodology We present an approach for audio-based event detection that solely relies on two microphones capturing the sound in the operating room. Therefore, a new data set was created with over 63 h of audio recorded and annotated at the University Hospital rechts der Isar. Sound files were labeled, preprocessed, augmented, and subsequently converted to log-mel-spectrograms that served as a visual input for an event classification using pretrained convolutional neural networks.

Results

Comparing multiple architectures, we were able to show that even lightweight models, such as MobileNet, can already provide promising results. Data augmentation additionally improved the classification of 11 defined classes, including inter alia different types of coagulation, operating table movements as well as an idle class. With the newly created audio data set, an overall accuracy of 90%, a precision of 91% and a F 1-score of 91% were achieved, demonstrating the feasibility of an audio-based event recognition in the operating room.

Conclusion

With this first proof of concept, we demonstrated that audio events can serve as a meaningful source of information that goes beyond spoken language and can easily be integrated into future workflow recognition pipelines using computational inexpensive architectures.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Operating RoomsHumansNeural Networks, ComputerWorkflow

Stichwörter der Autor:innen

Audio signal classificationEvent detectionSurgical sound analysisWorkflow analysis

Autor:innen und Institutionen

  • Research Group MITI, Klinikum rechts der Isar, TUM School of Medicine and Health, Technical University of Munich, Munich, Germany. jonas.fuchtmann@tum.de.
  • Department of Surgery, Klinikum rechts der Isar, TUM School of Medicine and Health, Technical University of Munich, Munich, Germany. jonas.fuchtmann@tum.de.
  • Research Group MITI, Klinikum rechts der Isar, TUM School of Medicine and Health, Technical University of Munich, Munich, Germany.
  • Department of Surgery, Klinikum rechts der Isar, TUM School of Medicine and Health, Technical University of Munich, Munich, Germany.
  • University Hospital of Hearing, Speech and Voice Disorders, Medical University of Innsbruck, Innsbruck, Austria.

Förderung

  • Technische Universität München

Zitieren

APA

Fuchtmann, J., Riedel, T., Berlet, M., Jell, A., Wegener, L., Wagner, L., Graf, S., Wilhelm, D., & Ostler-Mildner, D. (2024). Audio-based event detection in the operating room. International Journal of Computer Assisted Radiology and Surgery. https://doi.org/10.1007/s11548-024-03211-1

Vancouver

Fuchtmann J, Riedel T, Berlet M, Jell A, Wegener L, Wagner L, et al. Audio-based event detection in the operating room. International Journal of Computer Assisted Radiology and Surgery. 2024. doi:10.1007/s11548-024-03211-1

BibTeX
@article{Fuchtmann2024,
  author = {Fuchtmann, Jonas and Riedel, Thomas and Berlet, Maximilian and Jell, Alissa and Wegener, Luca and Wagner, Lars and Graf, Simone and Wilhelm, Dirk and Ostler-Mildner, Daniel},
  title = {Audio-based event detection in the operating room},
  journal = {International Journal of Computer Assisted Radiology and Surgery},
  year = {2024},
  doi = {10.1007/s11548-024-03211-1}
}
Kostenlos starten →