EUVIMEDEUVIMED entdecken
Crossref

EgoEMS: A High-Fidelity Multimodal Egocentric Dataset for Cognitive Assistance in Emergency Medical Services

Keshara Weerasinghe, Xueren Ge, Tessa Heick, Lahiru Nuwan Wijayasingha, Anthony Cortez, Abhishek Satpathy, John Stankovic, Homa Alemzadeh

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (46) · 39432-39441

DOI: 10.1609/aaai.v40i46.41293 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Keshara Weerasinghe und 7 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Emergency Medical Services (EMS) are critical to patient survival in emergencies, but first responders often face intense cognitive demands in high-stakes situations. AI cognitive assistants, acting as virtual partners, have the potential to ease this burden by supporting real-time data collection and decision making. In pursuit of this vision, we introduce EgoEMS, the first end-to-end, high-fidelity, multimodal, multiperson dataset capturing over 20 hours of realistic, procedural EMS activities from an egocentric view in 233 simulated emergency scenarios performed by 62 participants, including 46 EMS professionals. Developed in collaboration with EMS experts and aligned with national standards, EgoEMS is captured using an open-source, low-cost, and replicable data collection system and is annotated with keysteps, timestamped audio transcripts with speaker diarization, action quality metrics, and bounding boxes with segmentation masks. Emphasizing realism, the dataset includes responder-patient interactions reflecting real-world emergency dynamics. We also present a suite of benchmarks for real-time multimodal keystep recognition and action quality estimation, essential for developing AI support tools for EMS. We hope EgoEMS inspires the research community to push the boundaries of intelligent EMS systems and ultimately contribute to improved patient outcomes.

Zitieren

APA

Weerasinghe, K., Ge, X., Heick, T., Wijayasingha, L. N., Cortez, A., Satpathy, A., Stankovic, J., & Alemzadeh, H. (2026). EgoEMS: A High-Fidelity Multimodal Egocentric Dataset for Cognitive Assistance in Emergency Medical Services. Proceedings of the AAAI Conference on Artificial Intelligence, 40(46), 39432-39441. https://doi.org/10.1609/aaai.v40i46.41293

Vancouver

Weerasinghe K, Ge X, Heick T, Wijayasingha LN, Cortez A, Satpathy A, et al. EgoEMS: A High-Fidelity Multimodal Egocentric Dataset for Cognitive Assistance in Emergency Medical Services. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(46):39432-39441. doi:10.1609/aaai.v40i46.41293

BibTeX
@article{Weerasinghe2026,
  author = {Weerasinghe, Keshara and Ge, Xueren and Heick, Tessa and Wijayasingha, Lahiru Nuwan and Cortez, Anthony and Satpathy, Abhishek and Stankovic, John and Alemzadeh, Homa},
  title = {EgoEMS: A High-Fidelity Multimodal Egocentric Dataset for Cognitive Assistance in Emergency Medical Services},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {46},
  pages = {39432--39441},
  doi = {10.1609/aaai.v40i46.41293}
}
Kostenlos starten →