EUVIMEDScopri EUVIMED
Open access

Developing an Audit and Feedback Dashboard for Family Physicians: User-Centered Design Process

Jennifer Shuldiner iD, Tara Kiran iD, Payal Agarwal iD, Maryam Daneshvarfard iD, Kirsten Eldridge iD, Susie Kim iD, Michelle Greiver iD, Iffat Jokhio iD, Noah Ivers iD

JMIR Human Factors · 2023-11-09 · 10 · e47718

DOI: 10.2196/47718 ↗

At a glance

Journal article in JMIR Human Factors, published online on 2023-11-09. Written by Jennifer Shuldiner and 8 co-authors. Institution: Women's College Hospital, Toronto, ON, Canada. Major MEDLINE topics: Physicians, Family, User-Centered Design. Cited 5 times so far (Crossref); 25 references. The full text is freely available in PubMed Central.

AbstractSubjectsDati bibliograficiCiteRelated studies

Abstract (original language)

Background

Audit and feedback (A&F), the summary and provision of clinical performance data, is a common quality improvement strategy. Successful design and implementation of A&F—or any quality improvement strategy—should incorporate evidence-informed best practices as well as context-specific end user input.

Objective

We used A&F theory and user-centered design to inform the development of a web-based primary care A&F dashboard. We describe the design process and how it influenced the design of the dashboard.

Methods

Our design process included 3 phases: prototype development based on A&F theory and input from clinical improvement leaders; workshop with family physician quality improvement leaders to develop personas (ie, fictional users that represent an archetype character representative of our key users) and application of those personas to design decisions; and user-centered interviews with family physicians to learn about the physician’s reactions to the revised dashboard.

Results

The team applied A&F best practices to the dashboard prototype. Personas were used to identify target groups with challenges and behaviors as a tool for informed design decision-making. Our workshop produced 3 user personas, Dr Skeptic, Frazzled Physician, and Eager Implementer, representing common users based on the team’s experience of A&F. Interviews were conducted to further validate findings from the persona workshop and found that (1) physicians were interested in how they compare with peers; however, if performance was above average, they were not motivated to improve even if gaps compared to other standards in their care remained; (2) burnout levels were high as physicians are trying to catch up on missed care during the pandemic and are therefore less motivated to act on the data; and (3) additional desired features included integration within the electronic medical record, and more up-to-date and accurate data.

Conclusions

We found that carefully incorporating data from user interviews helped operationalize generic best practices for A&F to achieve an acceptable dashboard that could meet the needs and goals of physicians. We demonstrate such a design process in this paper. A&F dashboards should address physicians’ data skepticism, present data in a way that spurs action, and support physicians to have the time and capacity to engage in quality improvement work; the steps we followed may help those responsible for quality improvement strategy implementation achieve these aims.

Subjects

MeSH terms (MEDLINE)

Physicians, FamilyUser-Centered DesignHumansFeedbackLearningBurnout, Psychological

Author keywords

auditaudit and feedbackcareclinical performancedashboarddesigndevelopmentfamily physicianfeedbackimplementationprimary careuser-centeredusers

Authors and institutions

  • Women's College Hospital, Toronto, ON, Canada.
  • Department of Family and Community Medicine, University of Toronto, Toronto, ON, Canada.
  • St Michael's Hospital, Unity Health Toronto, Toronto, ON, Canada.
  • MAP Centre for Urban Health Solutions, St Michael's Hospital, Toronto, ON, Canada.
  • Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, ON, Canada.
  • Women's College Academic Family Health Team, Women's College Hospital, Toronto, ON, Canada.

ORCID profiles: Jennifer Shuldiner, Tara Kiran, Payal Agarwal, Maryam Daneshvarfard, Kirsten Eldridge, Susie Kim, Michelle Greiver, Iffat Jokhio, Noah Ivers

Cite

APA

Shuldiner, J., Kiran, T., Agarwal, P., Daneshvarfard, M., Eldridge, K., Kim, S., Greiver, M., Jokhio, I., & Ivers, N. (2023). Developing an Audit and Feedback Dashboard for Family Physicians: User-Centered Design Process. JMIR Human Factors, 10, e47718. https://doi.org/10.2196/47718

Vancouver

Shuldiner J, Kiran T, Agarwal P, Daneshvarfard M, Eldridge K, Kim S, et al. Developing an Audit and Feedback Dashboard for Family Physicians: User-Centered Design Process. JMIR Human Factors. 2023;10:e47718. doi:10.2196/47718

BibTeX
@article{Shuldiner2023,
  author = {Shuldiner, Jennifer and Kiran, Tara and Agarwal, Payal and Daneshvarfard, Maryam and Eldridge, Kirsten and Kim, Susie and Greiver, Michelle and Jokhio, Iffat and Ivers, Noah},
  title = {Developing an Audit and Feedback Dashboard for Family Physicians: User-Centered Design Process},
  journal = {JMIR Human Factors},
  year = {2023},
  volume = {10},
  pages = {e47718},
  doi = {10.2196/47718}
}
Start for free →