EUVIMEDScopri EUVIMED
Scoping ReviewOpen access

Development, Implementation, and Evaluation Methods for Dashboards in Health Care: Scoping Review

Danielle Helminski iD, Jeremy B Sussman iD, Paul N Pfeiffer iD, Alex N Kokaly iD, Allison Ranusch iD, Anjana Deep Renji iD, Laura J Damschroder iD, Zach Landis-Lewis iD, Jacob E Kurlander iD

JMIR Medical Informatics · 2024-12-10 · 12 · e59828-e59828

DOI: 10.2196/59828 ↗

At a glance

Scoping Review in JMIR Medical Informatics, published online on 2024-12-10. Written by Danielle Helminski and 8 co-authors. Institution: Department of Internal Medicine, University of Michigan, 2800 Plymouth Road, NCRC Building 14, Ann Arbor, MI, 48109, United States, 1 734 430 5359. Major MEDLINE topics: Delivery of Health Care. Cited 41 times so far (Crossref); 155 references. The full text is freely available in PubMed Central. Funded by: HSRD VA, NIDDK NIH HHS.

AbstractSubjectsDati bibliograficiCiteRelated studies

Abstract (original language)

Background

Dashboards have become ubiquitous in health care settings, but to achieve their goals, they must be developed, implemented, and evaluated using methods that help ensure they meet the needs of end users and are suited to the barriers and facilitators of the local context.

Objective

This scoping review aimed to explore published literature on health care dashboards to characterize the methods used to identify factors affecting uptake, strategies used to increase dashboard uptake, and evaluation methods, as well as dashboard characteristics and context.

Methods

MEDLINE, Embase, Web of Science, and the Cochrane Library were searched from inception through July 2020. Studies were included if they described the development or evaluation of a health care dashboard with publication from 2018‐2020. Clinical setting, purpose (categorized as clinical, administrative, or both), end user, design characteristics, methods used to identify factors affecting uptake, strategies to increase uptake, and evaluation methods were extracted.

Results

From 116 publications, we extracted data for 118 dashboards. Inpatient (45/118, 38.1%) and outpatient (42/118, 35.6%) settings were most common. Most dashboards had ≥2 stated purposes (84/118, 71.2%); of these, 54 of 118 (45.8%) were administrative, 43 of 118 (36.4%) were clinical, and 20 of 118 (16.9%) had both purposes. Most dashboards included frontline clinical staff as end users (97/118, 82.2%). To identify factors affecting dashboard uptake, half involved end users in the design process (59/118, 50%); fewer described formative usability testing (26/118, 22%) or use of any theory or framework to guide development, implementation, or evaluation (24/118, 20.3%). The most common strategies used to increase uptake included education (60/118, 50.8%); audit and feedback (59/118, 50%); and advisory boards (54/118, 45.8%). Evaluations of dashboards (84/118, 71.2%) were mostly quantitative (60/118, 50.8%), with fewer using only qualitative methods (6/118, 5.1%) or a combination of quantitative and qualitative methods (18/118, 15.2%).

Conclusions

Most dashboards forego steps during development to ensure they suit the needs of end users and the clinical context; qualitative evaluation—which can provide insight into ways to improve dashboard effectiveness—is uncommon. Education and audit and feedback are frequently used to increase uptake. These findings illustrate the need for promulgation of best practices in dashboard development and will be useful to dashboard planners.

Subjects

MeSH terms (MEDLINE)

Delivery of Health CareHumansBenchmarkingUser-Computer Interface

Author keywords

clinical managementclinical researchdashboardelectronic health recordemergency departmenthealth care systeminpatientmedical informaticsmonitoringpatient carequality improvementscoping review

Authors and institutions

  • Department of Internal Medicine, University of Michigan, 2800 Plymouth Road, NCRC Building 14, Ann Arbor, MI, 48109, United States, 1 734 430 5359.
  • Institute for Healthcare Policy and Innovation, University of Michigan, Ann Arbor, MI, United States.
  • Veterans Affairs Ann Arbor Center for Clinical Management Research, Ann Arbor, MI, United States.
  • Department of Psychiatry, University of Michigan, Ann Arbor, MI, United States.
  • Department of Medicine, University of California Los Angeles Health, Los Angeles, CA, United States.
  • Department of Learning Health Sciences, University of Michigan, Ann Arbor, MI, United States.

ORCID profiles: Danielle Helminski, Jeremy B Sussman, Paul N Pfeiffer, Alex N Kokaly, Allison Ranusch, Anjana Deep Renji, Laura J Damschroder, Zach Landis-Lewis, Jacob E Kurlander

Funding

  • HSRD VA
  • NIDDK NIH HHS

Cite

APA

Helminski, D., Sussman, J. B., Pfeiffer, P. N., Kokaly, A. N., Ranusch, A., Renji, A. D., Damschroder, L. J., Landis-Lewis, Z., & Kurlander, J. E. (2024). Development, Implementation, and Evaluation Methods for Dashboards in Health Care: Scoping Review. JMIR Medical Informatics, 12, e59828-e59828. https://doi.org/10.2196/59828

Vancouver

Helminski D, Sussman JB, Pfeiffer PN, Kokaly AN, Ranusch A, Renji AD, et al. Development, Implementation, and Evaluation Methods for Dashboards in Health Care: Scoping Review. JMIR Medical Informatics. 2024;12:e59828-e59828. doi:10.2196/59828

BibTeX
@article{Helminski2024,
  author = {Helminski, Danielle and Sussman, Jeremy B and Pfeiffer, Paul N and Kokaly, Alex N and Ranusch, Allison and Renji, Anjana Deep and Damschroder, Laura J and Landis-Lewis, Zach and Kurlander, Jacob E},
  title = {Development, Implementation, and Evaluation Methods for Dashboards in Health Care: Scoping Review},
  journal = {JMIR Medical Informatics},
  year = {2024},
  volume = {12},
  pages = {e59828--e59828},
  doi = {10.2196/59828}
}
Start for free →