EUVIMEDEUVIMED entdecken
Systematische ÜbersichtUmbrella ReviewOpen Access

AI Quality Standards in Health Care: Rapid Umbrella Review

Craig E Kuziemsky iD, Dillon Chrimes iD, Simon Minshall iD, Michael Mannerow iD, Francis Lau iD

Journal of Medical Internet Research · 22.05.2024 · 26 · e54705

DOI: 10.2196/54705 ↗

Kurz gefasst

Systematische Übersicht in der Zeitschrift Journal of Medical Internet Research, online erschienen am 22.05.2024. Verfasst von Craig E Kuziemsky und 4 weiteren Autor:innen. Beteiligte Einrichtung: MacEwan University, Edmonton, AB, Canada. Hauptthemen laut MEDLINE: Artificial Intelligence. Die Arbeit wurde bisher 27-mal zitiert (Crossref) und nennt 77 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

In recent years, there has been an upwelling of artificial intelligence (AI) studies in the health care literature. During this period, there has been an increasing number of proposed standards to evaluate the quality of health care AI studies.

Objective

This rapid umbrella review examines the use of AI quality standards in a sample of health care AI systematic review articles published over a 36-month period.

Methods

We used a modified version of the Joanna Briggs Institute umbrella review method. Our rapid approach was informed by the practical guide by Tricco and colleagues for conducting rapid reviews. Our search was focused on the MEDLINE database supplemented with Google Scholar. The inclusion criteria were English-language systematic reviews regardless of review type, with mention of AI and health in the abstract, published during a 36-month period. For the synthesis, we summarized the AI quality standards used and issues noted in these reviews drawing on a set of published health care AI standards, harmonized the terms used, and offered guidance to improve the quality of future health care AI studies.

Results

We selected 33 review articles published between 2020 and 2022 in our synthesis. The reviews covered a wide range of objectives, topics, settings, designs, and results. Over 60 AI approaches across different domains were identified with varying levels of detail spanning different AI life cycle stages, making comparisons difficult. Health care AI quality standards were applied in only 39% (13/33) of the reviews and in 14% (25/178) of the original studies from the reviews examined, mostly to appraise their methodological or reporting quality. Only a handful mentioned the transparency, explainability, trustworthiness, ethics, and privacy aspects. A total of 23 AI quality standard–related issues were identified in the reviews. There was a recognized need to standardize the planning, conduct, and reporting of health care AI studies and address their broader societal, ethical, and regulatory implications.

Conclusions

Despite the growing number of AI standards to assess the quality of health care AI studies, they are seldom applied in practice. With increasing desire to adopt AI in different health topics, domains, and settings, practitioners and researchers must stay abreast of and adapt to the evolving landscape of health care AI quality standards and apply these standards to improve the quality of their AI studies.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Artificial IntelligenceHumansDelivery of Health CareQuality of Health Care

Stichwörter der Autor:innen

artificial intelligencehealth care AIhealth care artificial intelligencequality standardrapid reviewumbrella review

Autor:innen und Institutionen

  • MacEwan University, Edmonton, AB, Canada.
  • School of Health Information Science, University of Victoria, Victoria, BC, Canada.

ORCID-Profile: Craig E Kuziemsky, Dillon Chrimes, Simon Minshall, Michael Mannerow, Francis Lau

Zitieren

APA

Kuziemsky, C. E., Chrimes, D., Minshall, S., Mannerow, M., & Lau, F. (2024). AI Quality Standards in Health Care: Rapid Umbrella Review. Journal of Medical Internet Research, 26, e54705. https://doi.org/10.2196/54705

Vancouver

Kuziemsky CE, Chrimes D, Minshall S, Mannerow M, Lau F. AI Quality Standards in Health Care: Rapid Umbrella Review. Journal of Medical Internet Research. 2024;26:e54705. doi:10.2196/54705

BibTeX
@article{Kuziemsky2024,
  author = {Kuziemsky, Craig E and Chrimes, Dillon and Minshall, Simon and Mannerow, Michael and Lau, Francis},
  title = {AI Quality Standards in Health Care: Rapid Umbrella Review},
  journal = {Journal of Medical Internet Research},
  year = {2024},
  volume = {26},
  pages = {e54705},
  doi = {10.2196/54705}
}
Kostenlos starten →