EUVIMEDOpdag EUVIMED
Qualitative StudieOpen access

Development and Integration of Machine Learning Algorithm to Identify Peripheral Arterial Disease: Multistakeholder Qualitative Study

Sabrina M Wang iD, H D Jeffry Hogg iD, Devdutta Sangvai iD, Manesh R Patel iD, E Hope Weissler iD, Katherine C Kellogg iD, William Ratliff iD, Suresh Balu iD, Mark Sendak iD

JMIR Formative Research · 2023-09-21 · 7 · e43963

DOI: 10.2196/43963 ↗

At a glance

Qualitative Studie in JMIR Formative Research, published online on 2023-09-21. Written by Sabrina M Wang and 8 co-authors. Institution: Duke University School of Medicine, Durham, NC, United States. Cited 6 times so far (Crossref); 55 references. The full text is freely available in PubMed Central.

AbstractSubjectsBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Background

Machine learning (ML)–driven clinical decision support (CDS) continues to draw wide interest and investment as a means of improving care quality and value, despite mixed real-world implementation outcomes.

Objective

This study aimed to explore the factors that influence the integration of a peripheral arterial disease (PAD) identification algorithm to implement timely guideline-based care.

Methods

A total of 12 semistructured interviews were conducted with individuals from 3 stakeholder groups during the first 4 weeks of integration of an ML-driven CDS. The stakeholder groups included technical, administrative, and clinical members of the team interacting with the ML-driven CDS. The ML-driven CDS identified patients with a high probability of having PAD, and these patients were then reviewed by an interdisciplinary team that developed a recommended action plan and sent recommendations to the patient’s primary care provider. Pseudonymized transcripts were coded, and thematic analysis was conducted by a multidisciplinary research team.

Results

Three themes were identified: positive factors translating in silico performance to real-world efficacy, organizational factors and data structure factors affecting clinical impact, and potential challenges to advancing equity. Our study found that the factors that led to successful translation of in silico algorithm performance to real-world impact were largely nontechnical, given adequate efficacy in retrospective validation, including strong clinical leadership, trustworthy workflows, early consideration of end-user needs, and ensuring that the CDS addresses an actionable problem. Negative factors of integration included failure to incorporate the on-the-ground context, the lack of feedback loops, and data silos limiting the ML-driven CDS. The success criteria for each stakeholder group were also characterized to better understand how teams work together to integrate ML-driven CDS and to understand the varying needs across stakeholder groups.

Conclusions

Longitudinal and multidisciplinary stakeholder engagement in the development and integration of ML-driven CDS underpins its effective translation into real-world care. Although previous studies have focused on the technical elements of ML-driven CDS, our study demonstrates the importance of including administrative and operational leaders as well as an early consideration of clinicians’ needs. Seeing how different stakeholder groups have this more holistic perspective also permits more effective detection of context-driven health care inequities, which are uncovered or exacerbated via ML-driven CDS integration through structural and organizational challenges. Many of the solutions to these inequities lie outside the scope of ML and require coordinated systematic solutions for mitigation to help reduce disparities in the care of patients with PAD.

Subjects

Author keywords

algorithmbarrierclinicaldetectiondevelopmentefficacyengagementimplementationintegrationmachine learningperipheral arterial diseasequalitystructuresupporttranslation

Authors and institutions

  • Duke University School of Medicine, Durham, NC, United States.
  • Population Health Science Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, United Kingdom.
  • Newcastle Eye Centre, Royal Victoria Infirmary, Newcastle upon Tyne, United Kingdom.
  • Population Health Management, Duke Health, Durham, NC, United States.
  • Department of Cardiology, Duke University, Durham, NC, United States.
  • Department of Vascular Surgery, Duke University, Durham, NC, United States.

ORCID profiles: Sabrina M Wang, H D Jeffry Hogg, Devdutta Sangvai, Manesh R Patel, E Hope Weissler, Katherine C Kellogg, William Ratliff, Suresh Balu, Mark Sendak

Cite

APA

Wang, S. M., Hogg, H. D. J., Sangvai, D., Patel, M. R., Weissler, E. H., Kellogg, K. C., Ratliff, W., Balu, S., & Sendak, M. (2023). Development and Integration of Machine Learning Algorithm to Identify Peripheral Arterial Disease: Multistakeholder Qualitative Study. JMIR Formative Research, 7, e43963. https://doi.org/10.2196/43963

Vancouver

Wang SM, Hogg HDJ, Sangvai D, Patel MR, Weissler EH, Kellogg KC, et al. Development and Integration of Machine Learning Algorithm to Identify Peripheral Arterial Disease: Multistakeholder Qualitative Study. JMIR Formative Research. 2023;7:e43963. doi:10.2196/43963

BibTeX
@article{Wang2023,
  author = {Wang, Sabrina M and Hogg, H D Jeffry and Sangvai, Devdutta and Patel, Manesh R and Weissler, E Hope and Kellogg, Katherine C and Ratliff, William and Balu, Suresh and Sendak, Mark},
  title = {Development and Integration of Machine Learning Algorithm to Identify Peripheral Arterial Disease: Multistakeholder Qualitative Study},
  journal = {JMIR Formative Research},
  year = {2023},
  volume = {7},
  pages = {e43963},
  doi = {10.2196/43963}
}
Start for free →