Development, Implementation, and Evaluation Methods for Dashboards in Health Care: Scoping Review
JMIR Medical Informatics · 2024-12-10 · 12 · e59828-e59828
DOI: 10.2196/59828 ↗At a glance
Scoping Review in JMIR Medical Informatics, published online on 2024-12-10. Written by Danielle Helminski and 8 co-authors. Institution: Department of Internal Medicine, University of Michigan, 2800 Plymouth Road, NCRC Building 14, Ann Arbor, MI, 48109, United States, 1 734 430 5359. Major MEDLINE topics: Delivery of Health Care. Cited 41 times so far (Crossref); 155 references. The full text is freely available in PubMed Central. Funded by: HSRD VA, NIDDK NIH HHS.
Abstract (original language)
Background
Dashboards have become ubiquitous in health care settings, but to achieve their goals, they must be developed, implemented, and evaluated using methods that help ensure they meet the needs of end users and are suited to the barriers and facilitators of the local context.
Objective
This scoping review aimed to explore published literature on health care dashboards to characterize the methods used to identify factors affecting uptake, strategies used to increase dashboard uptake, and evaluation methods, as well as dashboard characteristics and context.
Methods
MEDLINE, Embase, Web of Science, and the Cochrane Library were searched from inception through July 2020. Studies were included if they described the development or evaluation of a health care dashboard with publication from 2018‐2020. Clinical setting, purpose (categorized as clinical, administrative, or both), end user, design characteristics, methods used to identify factors affecting uptake, strategies to increase uptake, and evaluation methods were extracted.
Results
From 116 publications, we extracted data for 118 dashboards. Inpatient (45/118, 38.1%) and outpatient (42/118, 35.6%) settings were most common. Most dashboards had ≥2 stated purposes (84/118, 71.2%); of these, 54 of 118 (45.8%) were administrative, 43 of 118 (36.4%) were clinical, and 20 of 118 (16.9%) had both purposes. Most dashboards included frontline clinical staff as end users (97/118, 82.2%). To identify factors affecting dashboard uptake, half involved end users in the design process (59/118, 50%); fewer described formative usability testing (26/118, 22%) or use of any theory or framework to guide development, implementation, or evaluation (24/118, 20.3%). The most common strategies used to increase uptake included education (60/118, 50.8%); audit and feedback (59/118, 50%); and advisory boards (54/118, 45.8%). Evaluations of dashboards (84/118, 71.2%) were mostly quantitative (60/118, 50.8%), with fewer using only qualitative methods (6/118, 5.1%) or a combination of quantitative and qualitative methods (18/118, 15.2%).
Conclusions
Most dashboards forego steps during development to ensure they suit the needs of end users and the clinical context; qualitative evaluation—which can provide insight into ways to improve dashboard effectiveness—is uncommon. Education and audit and feedback are frequently used to increase uptake. These findings illustrate the need for promulgation of best practices in dashboard development and will be useful to dashboard planners.
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- Department of Internal Medicine, University of Michigan, 2800 Plymouth Road, NCRC Building 14, Ann Arbor, MI, 48109, United States, 1 734 430 5359.
- Institute for Healthcare Policy and Innovation, University of Michigan, Ann Arbor, MI, United States.
- Veterans Affairs Ann Arbor Center for Clinical Management Research, Ann Arbor, MI, United States.
- Department of Psychiatry, University of Michigan, Ann Arbor, MI, United States.
- Department of Medicine, University of California Los Angeles Health, Los Angeles, CA, United States.
- Department of Learning Health Sciences, University of Michigan, Ann Arbor, MI, United States.
ORCID profiles: Danielle Helminski, Jeremy B Sussman, Paul N Pfeiffer, Alex N Kokaly, Allison Ranusch, Anjana Deep Renji, Laura J Damschroder, Zach Landis-Lewis, Jacob E Kurlander
Funding
- HSRD VA
- NIDDK NIH HHS
Cite
APA
Helminski, D., Sussman, J. B., Pfeiffer, P. N., Kokaly, A. N., Ranusch, A., Renji, A. D., Damschroder, L. J., Landis-Lewis, Z., & Kurlander, J. E. (2024). Development, Implementation, and Evaluation Methods for Dashboards in Health Care: Scoping Review. JMIR Medical Informatics, 12, e59828-e59828. https://doi.org/10.2196/59828
Vancouver
Helminski D, Sussman JB, Pfeiffer PN, Kokaly AN, Ranusch A, Renji AD, et al. Development, Implementation, and Evaluation Methods for Dashboards in Health Care: Scoping Review. JMIR Medical Informatics. 2024;12:e59828-e59828. doi:10.2196/59828
BibTeX
@article{Helminski2024,
author = {Helminski, Danielle and Sussman, Jeremy B and Pfeiffer, Paul N and Kokaly, Alex N and Ranusch, Allison and Renji, Anjana Deep and Damschroder, Laura J and Landis-Lewis, Zach and Kurlander, Jacob E},
title = {Development, Implementation, and Evaluation Methods for Dashboards in Health Care: Scoping Review},
journal = {JMIR Medical Informatics},
year = {2024},
volume = {12},
pages = {e59828--e59828},
doi = {10.2196/59828}
}
EUVIMED