Usability Testing of Situation Awareness Clinical Decision Support in the Intensive Care Unit
Applied Clinical Informatics · 01.03.2024 · 15 (02) · 327-334
DOI: 10.1055/a-2272-6184 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Clinical Informatics, erschienen am 01.03.2024. Verfasst von Matthew J Molloy und 6 weiteren Autor:innen. Beteiligte Einrichtung: Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, Ohio, United States. Hauptthemen laut MEDLINE: Decision Support Systems, Clinical, Intensive Care Units. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 31 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: AHRQ HHS, Agency for Healthcare Research and Quality.
Themen: Intensivpflege
Abstract (Originalsprache)
Objective
Our objective was to evaluate the usability of an automated clinical decision support (CDS) tool previously implemented in the pediatric intensive care unit (PICU) to promote shared situation awareness among the medical team to prevent serious safety events within children's hospitals.
Methods
We conducted a mixed-methods usability evaluation of a CDS tool in a PICU at a large, urban, quaternary, free-standing children's hospital in the Midwest. Quantitative assessment was done using the system usability scale (SUS), while qualitative assessment involved think-aloud usability testing. The SUS was scored according to survey guidelines. For think-aloud testing, task times were calculated, and means and standard deviations were determined, stratified by role. Qualitative feedback from participants and moderator observations were summarized.
Results
Fifty-one PICU staff members, including physicians, advanced practice providers, nurses, and respiratory therapists, completed the SUS, while ten participants underwent think-aloud usability testing. The overall median usability score was 87.5 (interquartile range: 80–95), with over 96% rating the tool's usability as “good” or “excellent.” Task completion times ranged from 2 to 92 seconds, with the quickest completion for reviewing high-risk criteria and the slowest for adding to high-risk criteria. Observations and participant responses from think-aloud testing highlighted positive aspects of learnability and clear display of complex information that is easily accessed, as well as opportunities for improvement in tool integration into clinical workflows.
Conclusion
The PICU Warning Tool demonstrates good usability in the critical care setting. This study demonstrates the value of postimplementation usability testing in identifying opportunities for continued improvement of CDS tools.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, Ohio, United States.
- Division of Hospital Medicine, Cincinnati Children's Hospital, Cincinnati, Ohio, United States.
- Division of Biomedical Informatics, Cincinnati Children's Hospital, Cincinnati, Ohio, United States.
- Division of Critical Care, Cincinnati Children's Hospital, Cincinnati, Ohio, United States.
- Brigham Young University, Provo, Utah, United States.
- James M. Anderson Center for Health Systems Excellence, Cincinnati Children's Hospital, Cincinnati, Ohio, United States.
Förderung
- AHRQ HHS
- Agency for Healthcare Research and Quality
Zitieren
APA
Molloy, M. J., Zackoff, M., Gifford, A., Hagedorn, P., Tegtmeyer, K., Britto, M. T., & Dewan, M. (2024). Usability Testing of Situation Awareness Clinical Decision Support in the Intensive Care Unit. Applied Clinical Informatics, 15(02), 327-334. https://doi.org/10.1055/a-2272-6184
Vancouver
Molloy MJ, Zackoff M, Gifford A, Hagedorn P, Tegtmeyer K, Britto MT, et al. Usability Testing of Situation Awareness Clinical Decision Support in the Intensive Care Unit. Applied Clinical Informatics. 2024;15(02):327-334. doi:10.1055/a-2272-6184
BibTeX
@article{Molloy2024,
author = {Molloy, Matthew J and Zackoff, Matthew and Gifford, Annika and Hagedorn, Philip and Tegtmeyer, Ken and Britto, Maria T and Dewan, Maya},
title = {Usability Testing of Situation Awareness Clinical Decision Support in the Intensive Care Unit},
journal = {Applied Clinical Informatics},
year = {2024},
volume = {15},
number = {02},
pages = {327--334},
doi = {10.1055/a-2272-6184}
}
EUVIMED