EUVIMEDEUVIMED entdecken
Open Access

Usability Testing of Situation Awareness Clinical Decision Support in the Intensive Care Unit

Matthew J Molloy, Matthew Zackoff, Annika Gifford, Philip Hagedorn, Ken Tegtmeyer, Maria T Britto, Maya Dewan

Applied Clinical Informatics · 01.03.2024 · 15 (02) · 327-334

DOI: 10.1055/a-2272-6184 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Clinical Informatics, erschienen am 01.03.2024. Verfasst von Matthew J Molloy und 6 weiteren Autor:innen. Beteiligte Einrichtung: Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, Ohio, United States. Hauptthemen laut MEDLINE: Decision Support Systems, Clinical, Intensive Care Units. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 31 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: AHRQ HHS, Agency for Healthcare Research and Quality.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objective

Our objective was to evaluate the usability of an automated clinical decision support (CDS) tool previously implemented in the pediatric intensive care unit (PICU) to promote shared situation awareness among the medical team to prevent serious safety events within children's hospitals.

Methods

We conducted a mixed-methods usability evaluation of a CDS tool in a PICU at a large, urban, quaternary, free-standing children's hospital in the Midwest. Quantitative assessment was done using the system usability scale (SUS), while qualitative assessment involved think-aloud usability testing. The SUS was scored according to survey guidelines. For think-aloud testing, task times were calculated, and means and standard deviations were determined, stratified by role. Qualitative feedback from participants and moderator observations were summarized.

Results

Fifty-one PICU staff members, including physicians, advanced practice providers, nurses, and respiratory therapists, completed the SUS, while ten participants underwent think-aloud usability testing. The overall median usability score was 87.5 (interquartile range: 80–95), with over 96% rating the tool's usability as “good” or “excellent.” Task completion times ranged from 2 to 92 seconds, with the quickest completion for reviewing high-risk criteria and the slowest for adding to high-risk criteria. Observations and participant responses from think-aloud testing highlighted positive aspects of learnability and clear display of complex information that is easily accessed, as well as opportunities for improvement in tool integration into clinical workflows.

Conclusion

The PICU Warning Tool demonstrates good usability in the critical care setting. This study demonstrates the value of postimplementation usability testing in identifying opportunities for continued improvement of CDS tools.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Decision Support Systems, ClinicalIntensive Care UnitsHumansAwarenessIntensive Care Units, Pediatric

Autor:innen und Institutionen

  • Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, Ohio, United States.
  • Division of Hospital Medicine, Cincinnati Children's Hospital, Cincinnati, Ohio, United States.
  • Division of Biomedical Informatics, Cincinnati Children's Hospital, Cincinnati, Ohio, United States.
  • Division of Critical Care, Cincinnati Children's Hospital, Cincinnati, Ohio, United States.
  • Brigham Young University, Provo, Utah, United States.
  • James M. Anderson Center for Health Systems Excellence, Cincinnati Children's Hospital, Cincinnati, Ohio, United States.

Förderung

  • AHRQ HHS
  • Agency for Healthcare Research and Quality

Zitieren

APA

Molloy, M. J., Zackoff, M., Gifford, A., Hagedorn, P., Tegtmeyer, K., Britto, M. T., & Dewan, M. (2024). Usability Testing of Situation Awareness Clinical Decision Support in the Intensive Care Unit. Applied Clinical Informatics, 15(02), 327-334. https://doi.org/10.1055/a-2272-6184

Vancouver

Molloy MJ, Zackoff M, Gifford A, Hagedorn P, Tegtmeyer K, Britto MT, et al. Usability Testing of Situation Awareness Clinical Decision Support in the Intensive Care Unit. Applied Clinical Informatics. 2024;15(02):327-334. doi:10.1055/a-2272-6184

BibTeX
@article{Molloy2024,
  author = {Molloy, Matthew J and Zackoff, Matthew and Gifford, Annika and Hagedorn, Philip and Tegtmeyer, Ken and Britto, Maria T and Dewan, Maya},
  title = {Usability Testing of Situation Awareness Clinical Decision Support in the Intensive Care Unit},
  journal = {Applied Clinical Informatics},
  year = {2024},
  volume = {15},
  number = {02},
  pages = {327--334},
  doi = {10.1055/a-2272-6184}
}
Kostenlos starten →